help needed with raid 6 filesystem with errors
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting "transid verify failed" errors on my btrfs filesystem (see attached dmesg | grep -i btrfs dump in btrfs_dmesg.txt). When I run a scrub, the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try that
again (happened 3 times now, and was the root cause of the transid verify failed errors possibly, at least they did not show up earlier
than the failed scrub). A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem with errors. There was never a crash/power failure, so the filesystem was unmounted at every reboot, but as said on 3 occasions (after a scrub), that unmount was with on of the four drives unresponsive.
Funnily enough, after a reboot every time the filesystem gets mounted without issues (the unresponsive drive is back online), and btrfs check --readonly claims the filesystem has no errors (see attached btrfs_sdd_check.txt).
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt), the super is in the attached btrfs_sdd_dump_super.txt
Not sure what to do next, so seeking your advice! The important data on the drive is backed up, and I'll be running a verify to see if there are any corruptions overnight. Would still like to try to save the filesystem if possible though.
best regards,
Bas
superblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------csum_type 1 (xxhash64)csum_size 8
csum 0x3de224bec6584bb7 [match]
bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7
label homedirs
generation 368950
root 12883568295936sys_array_size 193chunk_root_generation 367570root_level 1chunk_root 23134208chunk_root_level 1log_root 0log_root_transid 0log_root_level 0total_bytes 32006252888064bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096root_dir 6num_devices 4compat_flags 0x0compat_ro_flags 0x0incompat_flags 0x9e1
( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | RAID56 | SKINNY_METADATA | RAID1C34 )
cache_generation 368950uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb
dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016
dev_item.bytes_used 6774245556224
dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096) length 8388608 owner 2 stripe_len 65536 type SYSTEM|RAID1C4 io_align 65536 io_width 65536 sector_size 4096 num_stripes 4 sub_stripes 1 stripe 0 devid 1 offset 22020096 dev_uuid 9c8b19be-c344-4be0-9726-34bf674d0349 stripe 1 devid 2 offset 1048576 dev_uuid 0542bb91-9989-4155-aec2-3baf0d848675 stripe 2 devid 3 offset 1048576 dev_uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb stripe 3 devid 4 offset 1048576 dev_uuid 51f99a35-7fca-4f38-8469-5fa12a1623a7 backup_roots[4]: backup 0: backup_tree_root: 12883564068864 gen: 368949 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883562348544 gen: 368949 level: 2 backup_fs_root: 12883557957632 gen: 368949 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883558776832 gen: 368949 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4 backup 1: backup_tree_root: 12883568295936 gen: 368950 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883566575616 gen: 368950 level: 2 backup_fs_root: 12883559759872 gen: 368950 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883560382464 gen: 368950 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4 backup 2: backup_tree_root: 12883564462080 gen: 368947 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883563347968 gen: 368947 level: 2 backup_fs_root: 12883555663872 gen: 368947 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883562217472 gen: 368947 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4 backup 3: backup_tree_root: 12883566510080 gen: 368948 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883559759872 gen: 368948 level: 2 backup_fs_root: 12883553746944 gen: 368948 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883555434496 gen: 368948 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4
[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206 /dev/sde scanned by systemd-udevd (644) [ 13.379691] BTRFS: device label homedirs devid 3 transid 367206 /dev/sdd scanned by systemd-udevd (646) [ 13.382411] BTRFS: device label homedirs devid 4 transid 367206 /dev/sdc scanned by systemd-udevd (648) [ 13.398436] BTRFS: device label homedirs devid 1 transid 367206 /dev/sdg scanned by systemd-udevd (652) [ 13.750256] BTRFS info (device sdg): disk space caching is enabled [ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [ 14.712675] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [ 14.714555] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree [ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760)
[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on /dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928
referenced 13336378105856
Quoted 5 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting "transid verify failed" errors on my btrfs filesystem (see attached dmesg | grep -i btrfs dump in btrfs_dmesg.txt).
Scary! But in this case, it looks like they were automatically recovered already.
Quoted 5 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try that again (happened 3 times now, and was the root cause of the transid verify failed errors possibly, at least they did not show up earlier than the failed scrub).
That is quite common when disks fail. The extra IO load results in a firmware crash, either due to failure of the electronics disrupting the embedded CPU so it can't run any program correctly, or an error condition in the rest of the disk that the firmware doesn't handle properly. Any unflushed writes in the write cache at this time are lost. Lost metadata writes will result in parent transid verify failures later on.
Low end desktop drives have very large SCTERC timeouts but no SCTERC controls, so they have very long IO error retry loops (2 minutes). That can look like an intermittent failure in the logs, but in fact it's an ordinary remappable UNC sector. The kernel has a default timeout of 30 seconds, so the kernel forces a drive reset before the drive can report the bad block. The drive can often be used normally by setting the kernel timeout with 'echo 180 > /sys/block/sd.../device/timeout'.
Whether you _want_ to use a disk with firmware that waits two full minutes before reporting an IO error is a separate question, but this is a feature of several popular cheap drive models, and you _can_ use these disks if needed.
Quoted 5 lines
A new disk is on it's way to use btrfs replace,
but I'm not sure whehter that will be a wise choice for a filesystem with errors. There was never a crash/power failure, so the filesystem was unmounted at every reboot, but as said on 3 occasions (after a scrub), that unmount was with on of the four drives unresponsive.
Note that
1. in the logs each distinct bytenr occurs exactly once (more precisely, "not more than N - 1 times for a RAID profile with N copies"), and
2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 5 lines
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680)
Metadata pages are 16K by default, and filesystem pages are 4K on amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are btrfs replacing one broken metadata page on sdd using data from other mirrors.
If you are using raid1* metadata, this is part of normal recovery from a disk failure.
The failing disk will not be keeping up with metadata updates (because it's failing, you can't assume it will be doing anything correctly). Writes will be lost on sdd that are not lost on the other mirror drives. btrfs will continue without error as long as at least one mirror drive is OK. btrfs will notice during later reads that some metadata pages are not up to date on the failing disk, and correct the failing disk using redundant copies of the metadata from the other mirrors.
Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is part of the cost of nodatacow--no recovery from data corruption errors.
Quoted 4 lines
Funnily enough, after a reboot every time the filesystem gets mounted without issues (the unresponsive drive is back online), and btrfs check --readonly claims the filesystem has no errors (see attached btrfs_sdd_check.txt).
There's no error on the disk by the time you run btrfs check or reboot and mount again. "read error corrected" means correct data was written back to the failing disk. With UNC sector remapping in disk firmware, btrfs could even repair the UNC sector so the disk is no longer failing. The only hint would be "Reallocated sector count" in SMART stats--and only if you are lucky enough to have that count reported accurately by your drive firmware.
Possibly there are still error errors on disk, but btrfs check didn't happen to read that particular block from that particular mirror. btrfs check won't verify the contents of every mirror are correct--that is what scrub is for. If btrfs check passes, it means at least one usable copy has been found for every metadata page in the filesystem. Scrub can handle all remaining errors.
Quoted 9 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here,
see https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt),
the super is in the attached btrfs_sdd_dump_super.txtNot sure what to do next, so seeking your advice! The important data on the drive is backed up, and I'll be running a verify to see if there are any corruptions overnight. Would still like to try to save the filesystem if possible though.
Replace the disk as usual. There's no indication of unrecoverable metadata failure. btrfs found some damage on the failing disk, but repaired it automatically.
Run 'btrfs replace' to reconstruct the content of the failing drive on the new one. Run a scrub after that's done to make sure all errors were corrected (or identify damaged raid6 data blocks if they were not), then resume your normal scrubbing schedule.
If possible, try keeping the old disk online during the replace operation, in case there are errors on other disks too. Use 'btrfs replace -r' to prefer to read from other disks, and only use the failing disk as a last resort. Don't try too hard--a failing disk is a failing disk, so if it's really broken, then let it go.
There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/
btrfs replace may hang a few times during recovery. Reboot to work around that bug (btrfs-replace-wrong-state-after-exit and btrfs-replace-lockup).
You may lose a few data blocks here and there (a "few" meaning about "one in ten thousand corrupted blocks"). You can identify which data blocks using scrub, or simply try to read all files and note any IO errors encountered. Delete the broken files and replace their content from backups to work around that bug (read-repair-failure, parity-update-failure).
Quoted 229 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------csum_type1 (xxhash64)csum_size8
csum0x3de224bec6584bb7[match]
bytenr 65536
flags0x1
( WRITTEN )
magic_BHRfS_M[match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7metadata_uuidfce03447-ad88-4891-b91f-390665fcd5e7
label homedirs
generation 368950
root 12883568295936sys_array_size193chunk_root_generation367570root_level1chunk_root23134208chunk_root_level1log_root0log_root_transid0log_root_level0total_bytes32006252888064bytes_used13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096root_dir6num_devices4compat_flags0x0compat_ro_flags0x0incompat_flags0x9e1( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | RAID56 | SKINNY_METADATA | RAID1C34 )
cache_generation368950uuid_tree_generation368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb
dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016
dev_item.bytes_used 6774245556224
dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096) length 8388608 owner 2 stripe_len 65536 type SYSTEM|RAID1C4 io_align 65536 io_width 65536 sector_size 4096 num_stripes 4 sub_stripes 1 stripe 0 devid 1 offset 22020096 dev_uuid 9c8b19be-c344-4be0-9726-34bf674d0349 stripe 1 devid 2 offset 1048576 dev_uuid 0542bb91-9989-4155-aec2-3baf0d848675 stripe 2 devid 3 offset 1048576 dev_uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb stripe 3 devid 4 offset 1048576 dev_uuid 51f99a35-7fca-4f38-8469-5fa12a1623a7 backup_roots[4]: backup 0: backup_tree_root: 12883564068864 gen: 368949 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883562348544 gen: 368949 level: 2 backup_fs_root: 12883557957632 gen: 368949 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883558776832 gen: 368949 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4 backup 1: backup_tree_root: 12883568295936 gen: 368950 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883566575616 gen: 368950 level: 2 backup_fs_root: 12883559759872 gen: 368950 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883560382464 gen: 368950 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4 backup 2: backup_tree_root: 12883564462080 gen: 368947 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883563347968 gen: 368947 level: 2 backup_fs_root: 12883555663872 gen: 368947 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883562217472 gen: 368947 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4 backup 3: backup_tree_root: 12883566510080 gen: 368948 level: 1 backup_chunk_root: 23134208 gen: 367570 level: 1 backup_extent_root: 12883559759872 gen: 368948 level: 2 backup_fs_root: 12883553746944 gen: 368948 level: 2 backup_dev_root: 12883678691328 gen: 367580 level: 1 backup_csum_root: 12883555434496 gen: 368948 level: 3 backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206 /dev/sde scanned by systemd-udevd (644) [ 13.379691] BTRFS: device label homedirs devid 3 transid 367206 /dev/sdd scanned by systemd-udevd (646) [ 13.382411] BTRFS: device label homedirs devid 4 transid 367206 /dev/sdc scanned by systemd-udevd (648) [ 13.398436] BTRFS: device label homedirs devid 1 transid 367206 /dev/sdg scanned by systemd-udevd (652) [ 13.750256] BTRFS info (device sdg): disk space caching is enabled [ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [ 14.712675] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [ 14.714555] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree [ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928
referenced 13336378105856
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70 /dev/sdX for all 4 drives in the array (the drives do support this)
2) echo 180 > /sys/block/sdX/device/timeout for all 4 drives
with that I attempted another scrub (on the single failing device, not on the filesystem), but with bad results again. The drive is basically still not responsive after the first error, this is the error according to smartctl:
Error 4 occurred at disk power-on lifetime: 7124 hours (296 days + 20 hours)
When the command that caused the error occurred, the device was
active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA = 0x00002468 = 9320
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUED
The other errors are all the same (Error: UNC at LBA = 0x00002468 = 9320), and at exactly the same LBA, once scrub gets to this LBA, the drives basically no longer responds, and querying it with smartctl will return garbage characters, or nothing at all. I've attached a dmesg with also the io errors this time.
So: I conclude scub is not going to fix this problem, and I should really replace the disk.
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing disk if at least 2 other disks are failing at that spot (given it's raid6), correct? If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the disk, it will just crash again and ruin my replace.
thanks!
Quoted 154 lines · Zygo Blaxell
Quoted 5 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting "transid verify failed" errors on my btrfs filesystem (see attached dmesg | grep -i btrfs dump in btrfs_dmesg.txt).
Scary! But in this case, it looks like they were automatically recovered
already.Quoted 6 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try that again (happened 3 times now, and was the root cause of the transid
verify failed errors possibly, at least they did not show up earlier than the failed scrub).That is quite common when disks fail. The extra IO load results in a firmware crash, either due to failure of the electronics disrupting the embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly. Any unflushed writes in the write cache at this time are lost. Lost metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC controls, so they have very long IO error retry loops (2 minutes). That can look like an intermittent failure in the logs, but in fact it's
an ordinary remappable UNC sector. The kernel has a default timeout of 30 seconds, so the kernel forces a drive reset before the drive can report the bad block. The drive can often be used normally by setting the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full minutes before reporting an IO error is a separate question, but this is a feature of several popular cheap drive models, and you _can_ use these disks if needed.
Quoted 5 lines
A new disk is on it's way to use btrfs replace,
but I'm not sure whehter that will be a wise choice for a filesystem with errors. There was never a crash/power failure, so the filesystem was unmounted at every reboot, but as said on 3 occasions (after a scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once (more precisely, "not more than N - 1 times for a RAID profile with N copies"), and
2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 13 lines
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0Quoted 2 lines
off 12884760735744 (dev
/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery from a disk failure.
The failing disk will not be keeping up with metadata updates (because it's failing, you can't assume it will be doing anything correctly). Writes will be lost on sdd that are not lost on the other mirror drives.
btrfs will continue without error as long as at least one mirror drive is OK. btrfs will notice during later reads that some metadata pages are not up to date on the failing disk, and correct the failing disk using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is part of the cost of nodatacow--no recovery from data corruption errors.
Quoted 4 lines
Funnily enough, after a reboot every time the filesystem gets mounted without issues (the unresponsive drive is back online), and btrfs check --readonly claims the filesystem has no errors (see attached btrfs_sdd_check.txt).
There's no error on the disk by the time you run btrfs check or reboot and
mount again. "read error corrected" means correct data was written back
to the failing disk. With UNC sector remapping in disk firmware, btrfs could even repair the UNC sector so the disk is no longer failing. The only hint would be "Reallocated sector count" in SMART stats--and only if you are lucky enough to have that count reported accurately by your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't happen to read that particular block from that particular mirror. btrfs check won't verify the contents of every mirror are correct--that is what scrub is for. If btrfs check passes, it means at least one usable copy has been found for every metadata page in the filesystem. Scrub can handle all remaining errors.
Quoted 10 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtNot sure what to do next, so seeking your advice! The important data on the drive is backed up, and I'll be running a verify to see if there are any corruptions overnight. Would still like to try to save the filesystem if possible though.
Replace the disk as usual. There's no indication of unrecoverable metadata failure. btrfs found some damage on the failing disk, but repaired it automatically.
Run 'btrfs replace' to reconstruct the content of the failing drive on the new one. Run a scrub after that's done to make sure all errors were corrected (or identify damaged raid6 data blocks if they were not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace -r' to prefer to read from other disks, and only use the failing disk as a last resort. Don't try too hard--a failing disk is a failing disk, so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/
btrfs replace may hang a few times during recovery. Reboot to work around
that bug (btrfs-replace-wrong-state-after-exit and btrfs-replace- lockup).
Quoted 348 lines
You may lose a few data blocks here and there (a "few" meaning about "one in ten thousand corrupted blocks"). You can identify which data blocks using scrub, or simply try to read all files and note any IO errors encountered. Delete the broken files and replace their content from backups to work around that bug (read-repair-failure, parity-update-failure).
Quoted 340 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match]
bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936
sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|
BIG_METADATA|
EXTENDED_IREF|
RAID56 |
SKINNY_METADATA|
RAID1C34 )
cache_generation 368950
uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match] dev_item.type 0
dev_item.total_bytes 8001563222016
dev_item.bytes_used 6774245556224
dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096num_stripes4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349 stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675 stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7 backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled [ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21
[ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0off 12886944968704 (dev
/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856
[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks
[ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off
[ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00
[ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk
[ 13.368410] BTRFS: device label homedirs devid 2 transid 367206 /dev/sde scanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206 /dev/sdd scanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206 /dev/sdc scanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206 /dev/sdg scanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents
[ 14.710747] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21
[ 25.444099] BTRFS info (device sdg): checking UUID tree
[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3
[ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21
[ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd
[ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125
[ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779
[ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688)
[ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696)
[ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704)
[ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712)
[ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635
[ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056)
[ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064)
[ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072)
[ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080)
[ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780
[ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200)
[ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208)
[ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780
[ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780
[ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635
[ 6378.896860] repair_io_failure: 10 callbacks suppressed
[ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296)
[ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304)
[ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312)
[ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320)
[ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635
[ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808)
[ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816)
[ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824)
[ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832)
[ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635
[ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080)
[ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088)
[ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635
[ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635
[ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635
[ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635
[ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635
[ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635
[13673.751319] BTRFS info (device sdg): scrub: started on devid 3
[16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125
[23638.218998] BTRFS info (device sdg): disk space caching is enabled
[23638.220428] BTRFS info (device sdg): has skinny extents
[23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101
[38079.457874] repair_io_failure: 26 callbacks suppressed
[38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656)
[38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664)
[38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672)
[38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680)
[38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612
[38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400)
[38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408)
[38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416)
[38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424)
[65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022
[65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032)
[65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040)
[65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048)
[65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056)
[70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1
[70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21
[70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456)
[70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1
[70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21
[70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448)
[85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594
[85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816)
[85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824)
[85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832)
[85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840)
[86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785
[86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656)
[86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664)
[86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672)
[86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680)
[89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579
[89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736)
[89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744)
[89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752)
[89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760)
[175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580
[175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432)
[175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440)
[175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448)
[175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456)
[176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607
[176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296)
[176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304)
[176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312)
[176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320)
[229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535
[229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288)
[229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296)
[229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304)
[229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312)
[229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535
[229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320)
[229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328)
[229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336)
[229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344)
[230214.519209] BTRFS info (device sdg): scrub: started on devid 3
[230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21
[230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd
[233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599
[233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336)
[233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344)
[233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352)
[233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360)
[233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704
[233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048)
[233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056)
[233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064)
[233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072)
[239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579
[239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968)
[239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976)
[239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984)
[239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992)
[241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632
[241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368)
[241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376)
[241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384)
[241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392)
[244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596
[244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432)
[244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440)
[244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448)
[244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456)
[244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594
[244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464)
[244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472)
[244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480)
[244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488)
[246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596
[246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752)
[246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760)
[246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768)
[246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776)
[248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23
[248185.324525] sas: trying to find task 0x0000000025b267cc
[248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc
[248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted
[248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted
[248185.327366] sas: trying to find task 0x0000000040e3e246
[248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246
[248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted
[248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted
[248185.330292] sas: trying to find task 0x0000000011fd3d76
[248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76
[248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted
[248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted
[248185.333270] sas: trying to find task 0x000000001aeb6768
[248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768
[248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted
[248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted
[248185.336363] sas: trying to find task 0x00000000dcb4fb6a
[248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a
[248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted
[248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted
[248185.339536] sas: trying to find task 0x00000000713475b5
[248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5
[248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted
[248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted
[248185.342853] sas: trying to find task 0x0000000022bf1484
[248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484
[248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted
[248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted
[248185.346232] sas: trying to find task 0x00000000c1be6881
[248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881
[248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted
[248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted
[248185.349675] sas: trying to find task 0x0000000094632cad
[248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad
[248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted
[248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted
[248185.353217] sas: trying to find task 0x00000000369ca205
[248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205
[248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted
[248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted
[248185.356849] sas: ata7: end_device-4:2: cmd error handler
[248185.356910] sas: ata5: end_device-4:0: dev error handler
[248185.356930] sas: ata6: end_device-4:1: dev error handler
[248185.356937] sas: ata7: end_device-4:2: dev error handler
[248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen
[248185.356949] sas: ata8: end_device-4:3: dev error handler
[248185.356984] sas: ata9: end_device-4:4: dev error handler
[248185.357000] sas: ata10: end_device-4:5: dev error handler
[248185.358239] ata7.00: failed command: READ FPDMA QUEUED
[248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in
res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error)
[248185.362113] ata7.00: status: { DRDY SENSE ERR }
[248185.363412] ata7.00: error: { UNC }
[248185.364702] ata7.00: failed command: READ FPDMA QUEUED
[248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in
res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.368705] ata7.00: status: { DRDY SENSE ERR }
[248185.370059] ata7.00: error: { ABRT }
[248185.371406] ata7.00: failed command: READ FPDMA QUEUED
[248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in
res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.375565] ata7.00: status: { DRDY SENSE ERR }
[248185.376985] ata7.00: error: { ABRT }
[248185.378416] ata7.00: failed command: READ FPDMA QUEUED
[248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in
res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.382668] ata7.00: status: { DRDY SENSE ERR }
[248185.384082] ata7.00: error: { ABRT }
[248185.385477] ata7.00: failed command: READ FPDMA QUEUED
[248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in
res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.389716] ata7.00: status: { DRDY SENSE ERR }
[248185.391135] ata7.00: error: { ABRT }
[248185.392535] ata7.00: failed command: READ FPDMA QUEUED
[248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in
res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.396777] ata7.00: status: { DRDY SENSE ERR }
[248185.398192] ata7.00: error: { ABRT }
[248185.399596] ata7.00: failed command: READ FPDMA QUEUED
[248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in
res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.403850] ata7.00: status: { DRDY SENSE ERR }
[248185.405203] ata7.00: error: { ABRT }
[248185.406527] ata7.00: failed command: READ FPDMA QUEUED
[248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in
res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.410355] ata7.00: status: { DRDY SENSE ERR }
[248185.411578] ata7.00: error: { ABRT }
[248185.412777] ata7.00: failed command: READ FPDMA QUEUED
[248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in
res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.416245] ata7.00: status: { DRDY SENSE ERR }
[248185.417361] ata7.00: error: { ABRT }
[248185.418456] ata7.00: failed command: READ FPDMA QUEUED
[248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in
res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.421744] ata7.00: status: { DRDY SENSE ERR }
[248185.422792] ata7.00: error: { ABRT }
[248185.423822] ata7.00: failed command: READ FPDMA QUEUED
[248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in
res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.426818] ata7.00: status: { DRDY SENSE ERR }
[248185.427812] ata7.00: error: { ABRT }
[248185.428803] ata7.00: failed command: READ FPDMA QUEUED
[248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in
res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.431691] ata7.00: status: { DRDY SENSE ERR }
[248185.432624] ata7.00: error: { ABRT }
[248185.433535] ata7.00: failed command: READ FPDMA QUEUED
[248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error)
[248185.436245] ata7.00: status: { DRDY SENSE ERR }
[248185.437136] ata7.00: error: { ABRT }
[248185.438016] ata7.00: failed command: READ FPDMA QUEUED
[248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.440604] ata7.00: status: { DRDY SENSE ERR }
[248185.441465] ata7.00: error: { ABRT }
[248185.442319] ata7.00: failed command: READ FPDMA QUEUED
[248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.444852] ata7.00: status: { DRDY SENSE ERR }
[248185.445689] ata7.00: error: { ABRT }
[248185.446501] ata7.00: failed command: READ FPDMA QUEUED
[248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.448944] ata7.00: status: { DRDY SENSE ERR }
[248185.449739] ata7.00: error: { ABRT }
[248185.450510] ata7.00: failed command: READ FPDMA QUEUED
[248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.452852] ata7.00: status: { DRDY SENSE ERR }
[248185.453617] ata7.00: error: { ABRT }
[248185.454362] ata7.00: failed command: READ FPDMA QUEUED
[248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.456633] ata7.00: status: { DRDY SENSE ERR }
[248185.457391] ata7.00: error: { ABRT }
[248185.458160] ata7.00: failed command: READ FPDMA QUEUED
[248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.460403] ata7.00: status: { DRDY SENSE ERR }
[248185.461144] ata7.00: error: { ABRT }
[248185.461877] ata7.00: failed command: READ FPDMA QUEUED
[248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.464121] ata7.00: status: { DRDY SENSE ERR }
[248185.464859] ata7.00: error: { ABRT }
[248185.465581] ata7.00: failed command: READ FPDMA QUEUED
[248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.467748] ata7.00: status: { DRDY SENSE ERR }
[248185.468453] ata7.00: error: { ABRT }
[248185.469167] ata7.00: failed command: READ FPDMA QUEUED
[248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.471309] ata7.00: status: { DRDY SENSE ERR }
[248185.472025] ata7.00: error: { ABRT }
[248185.472740] ata7.00: failed command: READ FPDMA QUEUED
[248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in
res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout)
[248185.474881] ata7.00: status: { DRDY SENSE ERR }
[248185.475598] ata7.00: error: { ABRT }
[248185.476291] ata7: hard resetting link
[248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)!
[248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0
[248192.916472] ata7.00: qc timeout (cmd 0xec)
[248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5)
[248192.919286] ata7.00: revalidation failed (errno=-5)
[248192.920627] ata7: hard resetting link
[248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)!
[248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0
[248205.717134] ata7.00: qc timeout (cmd 0xa1)
[248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5)
[248205.717234] ata7.00: revalidation failed (errno=-5)
[248205.717274] ata7: hard resetting link
[248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)!
[248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0
[248238.483453] ata7.00: qc timeout (cmd 0xa1)
[248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5)
[248238.486205] ata7.00: revalidation failed (errno=-5)
[248238.487539] ata7.00: disabled
[248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)!
[248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0
[248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s
[248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current]
[248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required
[248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00
[248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248240.882483] ata7: EH complete
[248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1
[248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00
[248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00
[248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00
[248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00
[248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0
[248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s
[248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00
[248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s
[248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00
[248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s
[248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00
[248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s
[248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00
[248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s
[248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0
[248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21
[248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21
[248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00
[248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21
[248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21
[248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>)
[248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21
[248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>)
[248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>)
[248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21
[248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>)
[248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21
[248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>)
[248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21
[248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21
[248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21
[248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd
[248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd
[248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd
[248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>)
[248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>)
[248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd
[248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>)
[248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>)
[248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd
[248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd
[248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd
[248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd
[248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd
[248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd
[248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248241.587414] BTRFS error (device sdg): error writing primary super block to device 3
[248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125
[248246.510344] scsi_io_completion_action: 2646 callbacks suppressed
[248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00
[248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00
[248246.519554] print_req_error: 2647 callbacks suppressed
[248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0
[248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0
[248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00
[248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0
[248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00
[248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00
[248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00
[248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00
[248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00
[248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00
[248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00
[248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00
[248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00
[248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00
[248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00
[248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00
[248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00
[248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00
[248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.400125] scsi_io_completion_action: 9 callbacks suppressed
[248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00
[248265.401974] print_req_error: 9 callbacks suppressed
[248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00
[248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00
[248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00
[248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00
[248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00
[248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00
[248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00
[248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00
[248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00
[248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.623282] scsi_io_completion_action: 5 callbacks suppressed
[248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00
[248271.625660] print_req_error: 5 callbacks suppressed
[248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00
[248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00
[248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00
[248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00
[248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00
[248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00
[248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00
[248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00
[248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00
[248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed
[248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21
[248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21
[248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248272.062041] BTRFS error (device sdg): error writing primary super block to device 3
[248277.001230] scsi_io_completion_action: 173 callbacks suppressed
[248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00
[248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00
[248277.006725] print_req_error: 174 callbacks suppressed
[248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00
[248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00
[248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00
[248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00
[248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00
[248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00
[248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00
[248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00
[248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00
[248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00
[248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00
[248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00
[248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00
[248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00
[248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00
[248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00
[248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00
[248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248291.988874] scsi_io_completion_action: 4 callbacks suppressed
[248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00
[248291.995414] print_req_error: 4 callbacks suppressed
[248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00
[248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00
[248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00
[248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00
[248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00
[248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00
[248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00
[248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00
[248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00
[248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00
[248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed
[248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21
[248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21
[248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21
[248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21
[248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21
[248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21
[248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21
[248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21
[248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21
[248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21
[248302.482352] scsi_io_completion_action: 71 callbacks suppressed
[248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00
[248302.488014] print_req_error: 71 callbacks suppressed
[248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00
[248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0
[248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00
[248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0
[248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00
[248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00
[248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00
[248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0
[248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00
[248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00
[248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00
[248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0
[248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00
[248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248303.078613] BTRFS error (device sdg): error writing primary super block to device 3
[248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248308.909087] scsi_io_completion_action: 401 callbacks suppressed
[248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00
[248308.915329] print_req_error: 402 callbacks suppressed
[248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00
[248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00
[248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00
[248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00
[248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0
[248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0
[248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00
[248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00
[248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00
[248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00
[248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00
[248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00
[248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00
[248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00
[248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00
[248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00
[248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00
[248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0
[248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00
[248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0
[248322.218635] scsi_io_completion_action: 7 callbacks suppressed
[248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00
[248322.222668] print_req_error: 7 callbacks suppressed
[248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0
[248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00
[248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00
[248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0
[248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0
[248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed
[248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21
[248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21
[248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00
[248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0
[248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21
[248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21
[248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00
[248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0
[248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00
[248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00
[248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0
[248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00
[248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00
[248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0
[248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00
[248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00
[248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00
[248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00
[248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00
[248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00
[248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00
[248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00
[248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0
[248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00
[248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00
[248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0
[248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0
[248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00
[248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248328.848446] nfsd: last server has exited, flushing export cache
[248333.202511] scsi_io_completion_action: 22 callbacks suppressed
[248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00
[248333.209604] print_req_error: 22 callbacks suppressed
[248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21
[248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00
[248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21
[248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00
[248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21
[248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00
[248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21
[248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00
[248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21
[248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00
[248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21
[248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00
[248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21
[248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00
[248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21
[248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00
[248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21
[248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00
[248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21
[248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248333.869878] BTRFS error (device sdg): error writing primary super block to device 3
[248343.130021] scsi_io_completion_action: 211 callbacks suppressed
[248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00
[248343.134638] print_req_error: 212 callbacks suppressed
[248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO
[248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00
[248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00
[248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00
[248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00
[248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00
[248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00
[248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00
[248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00
[248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0
[248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s
[248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00
[248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0
[248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00
[248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0
[248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed
[248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21
[248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5)
[248374.389718] BTRFS error (device sdg): error writing primary super block to device 3Quoted 29 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array (the drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device, not on the filesystem), but with bad results again. The drive is basically still not responsive after the first error, this is the error according to smartctl:
Error 4 occurred at disk power-on lifetime: 7124 hours (296 days + 20 hours)
When the command that caused the error occurred, the device was
active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUED
Quoted 8 lines
The other errors are all the same (Error: UNC at LBA =
0x00002468= 9320), and at exactly the same LBA, once scrub gets to this LBA, the drives basically no longer responds, and querying it with smartctl will return garbage characters, or nothing at all. I've attached a dmesg with also the io errors this time.So: I conclude scub is not going to fix this problem, and I should really replace the disk.
Agreed. It is now properly configured, there are UNC sectors logged in SMART, and UNC recovery is still not working. The drive is broken and will likely stay that way.
Quoted 4 lines
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing disk if at least 2 other disks are failing at that spot (given it's raid6), correct?
That's the general idea.
Quoted 3 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the disk, it will just crash again and ruin my replace.
There's still another redundant disk in the array, so there's no need to put too much effort into recovering one failing drive. The disk seems really broken, so take it offline and do a replace in degraded mode.
Quoted 1,429 lines
thanks!
Quoted 154 lines · Zygo Blaxell
Quoted 5 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting "transid verify failed" errors on my btrfs filesystem (see attached dmesg | grep -i btrfs dump in btrfs_dmesg.txt).
Scary! But in this case, it looks like they were automatically recovered
already.Quoted 6 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try that again (happened 3 times now, and was the root cause of the transid
verify failed errors possibly, at least they did not show up earlier than the failed scrub).That is quite common when disks fail. The extra IO load results in a firmware crash, either due to failure of the electronics disrupting the embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly. Any unflushed writes in the write cache at this time are lost. Lost metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC controls, so they have very long IO error retry loops (2 minutes). That can look like an intermittent failure in the logs, but in fact it's
an ordinary remappable UNC sector. The kernel has a default timeout of 30 seconds, so the kernel forces a drive reset before the drive can report the bad block. The drive can often be used normally by setting the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full minutes before reporting an IO error is a separate question, but this is a feature of several popular cheap drive models, and you _can_ use these disks if needed.
Quoted 5 lines
A new disk is on it's way to use btrfs replace,
but I'm not sure whehter that will be a wise choice for a filesystem with errors. There was never a crash/power failure, so the filesystem was unmounted at every reboot, but as said on 3 occasions (after a scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once (more precisely, "not more than N - 1 times for a RAID profile with N copies"), and
2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 13 lines
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0Quoted 2 lines
off 12884760735744 (dev
/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery from a disk failure.
The failing disk will not be keeping up with metadata updates (because it's failing, you can't assume it will be doing anything correctly). Writes will be lost on sdd that are not lost on the other mirror drives.
btrfs will continue without error as long as at least one mirror drive is OK. btrfs will notice during later reads that some metadata pages are not up to date on the failing disk, and correct the failing disk using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is part of the cost of nodatacow--no recovery from data corruption errors.
Quoted 4 lines
Funnily enough, after a reboot every time the filesystem gets mounted without issues (the unresponsive drive is back online), and btrfs check --readonly claims the filesystem has no errors (see attached btrfs_sdd_check.txt).
There's no error on the disk by the time you run btrfs check or reboot and
mount again. "read error corrected" means correct data was written back
to the failing disk. With UNC sector remapping in disk firmware, btrfs could even repair the UNC sector so the disk is no longer failing. The only hint would be "Reallocated sector count" in SMART stats--and only if you are lucky enough to have that count reported accurately by your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't happen to read that particular block from that particular mirror. btrfs check won't verify the contents of every mirror are correct--that is what scrub is for. If btrfs check passes, it means at least one usable copy has been found for every metadata page in the filesystem. Scrub can handle all remaining errors.
Quoted 10 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtNot sure what to do next, so seeking your advice! The important data on the drive is backed up, and I'll be running a verify to see if there are any corruptions overnight. Would still like to try to save the filesystem if possible though.
Replace the disk as usual. There's no indication of unrecoverable metadata failure. btrfs found some damage on the failing disk, but repaired it automatically.
Run 'btrfs replace' to reconstruct the content of the failing drive on the new one. Run a scrub after that's done to make sure all errors were corrected (or identify damaged raid6 data blocks if they were not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace -r' to prefer to read from other disks, and only use the failing disk as a last resort. Don't try too hard--a failing disk is a failing disk, so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/
btrfs replace may hang a few times during recovery. Reboot to work around
that bug (btrfs-replace-wrong-state-after-exit and btrfs-replace- lockup).Quoted 348 lines
You may lose a few data blocks here and there (a "few" meaning about "one in ten thousand corrupted blocks"). You can identify which data blocks using scrub, or simply try to read all files and note any IO errors encountered. Delete the broken files and replace their content from backups to work around that bug (read-repair-failure, parity-update-failure).
Quoted 340 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match]
bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936
sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|
BIG_METADATA|
EXTENDED_IREF|
RAID56 |
SKINNY_METADATA|
RAID1C34 )
cache_generation 368950
uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match] dev_item.type 0
dev_item.total_bytes 8001563222016
dev_item.bytes_used 6774245556224
dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096num_stripes4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349 stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675 stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7 backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled [ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21
[ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0off 12886944968704 (dev
/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical blocks: (8.00 TB/7.28 TiB) [ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off [ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206 /dev/sde scanned by systemd-udevd (644) [ 13.379691] BTRFS: device label homedirs devid 3 transid 367206 /dev/sdd scanned by systemd-udevd (646) [ 13.382411] BTRFS: device label homedirs devid 4 transid 367206 /dev/sdc scanned by systemd-udevd (648) [ 13.398436] BTRFS: device label homedirs devid 1 transid 367206 /dev/sdg scanned by systemd-udevd (652) [ 13.750256] BTRFS info (device sdg): disk space caching is enabled [ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [ 14.712675] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [ 14.714555] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree [ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error) [248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>) [248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>) [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>) [248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>) [248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>) [248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>) [248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>) [248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>) [248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>) [248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writing primary super block to device 3
Quoted 64 lines · Zygo Blaxell
Quoted 42 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array (the
drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device, not
on the filesystem), but with bad results again. The drive is basically
still not responsive after the first error, this is the error according
to smartctl:Error 4 occurred at disk power-on lifetime: 7124 hours (296 days + 20
hours)
When the command that caused the error occurred, the device was active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUEDThe other errors are all the same (Error: UNC at LBA =
0x00002468= 9320), and at exactly the same LBA, once scrub gets to this LBA, the
drives basically no longer responds, and querying it with smartctl will
return garbage characters, or nothing at all. I've attached a dmesg with also the io errors this time.Quoted 2 lines
So: I conclude scub is not going to fix this problem, and I should really replace the disk.
Agreed. It is now properly configured, there are UNC sectors logged in
SMART, and UNC recovery is still not working. The drive is broken and
will likely stay that way.Quoted 5 lines
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing
disk if at least 2 other disks are failing at that spot (given it's raid6), correct?That's the general idea.
Quoted 3 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the disk, it will just crash again and ruin my replace.
Quoted 5 lines
There's still another redundant disk in the array, so there's no need to
put too much effort into recovering one failing drive. The disk seems
really broken, so take it offline and do a replace in degraded mode.
Thanks for the clear help and explanations, I have 2 final questions (famous last words :-) )
1) In your earlier reply you mentioned known bugs, including the "Spurious read errors in btrfs raid5 degraded mode". Would replacing with "-r" while the faulty drive is still online not prevent this from happening? Assuming the replace speed is similar to the scrub speed, I'm looking at 4 days to replace the drive, would prefer if I could keep using the filesystem while that happens.. otherwise wiping it and restoring from backup might actually be the fastest option.
2) If I go the offline way, how would I actually do that? I do not see a command in the btrfs manual to flag a disk as faulty, or any other command to move into "degraded" mode. I could unplug it while power off ofcourse, is that the best / only way?
Quoted 2,402 lines
Quoted 2,401 lines
thanks!
Quoted 222 lines · Zygo Blaxell
Quoted 7 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting
"transid verify failed" errors on my btrfs filesystem (see attached
dmesg | grep -i btrfs dump in btrfs_dmesg.txt).Scary! But in this case, it looks like they were automatically recovered
already.Quoted 8 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try
that again (happened 3 times now, and was the root cause of the transid
verify failed errors possibly, at least they did not show up earlier
than the failed scrub).That is quite common when disks fail. The extra IO load results in a
firmware crash, either due to failure of the electronics disrupting the
embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly.
Any unflushed writes in the write cache at this time are lost. Lost
metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC
controls, so they have very long IO error retry loops (2 minutes).
That can look like an intermittent failure in the logs, but in fact
it's
an ordinary remappable UNC sector. The kernel has a default timeout
of 30 seconds, so the kernel forces a drive reset before the drive can
report the bad block. The drive can often be used normally by setting
the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full
minutes before reporting an IO error is a separate question, but this
is a feature of several popular cheap drive models, and you _can_ use
these disks if needed.Quoted 9 lines
A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem
with errors. There was never a crash/power failure, so the filesystem
was unmounted at every reboot, but as said on 3 occasions (after a
scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once (more
precisely, "not more than N - 1 times for a RAID profile with
N copies"), and2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 17 lines
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected:Quoted 3 lines
ino 0
off 12884760735744 (dev/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are
btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery from
a disk failure.The failing disk will not be keeping up with metadata updates (because
it's failing, you can't assume it will be doing anything correctly).
Writes will be lost on sdd that are not lost on the other mirror drives.
btrfs will continue without error as long as at least one mirror drive
is OK. btrfs will notice during later reads that some metadata pages
are not up to date on the failing disk, and correct the failing disk
using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is
part of the cost of nodatacow--no recovery from data corruption errors.Quoted 7 lines
Funnily enough, after a reboot every time the filesystem gets mounted
without issues (the unresponsive drive is back online), and btrfs
check --readonly claims the filesystem has no errors (see attached
btrfs_sdd_check.txt).There's no error on the disk by the time you run btrfs check or reboot
and
mount again. "read error corrected" means correct data was written
back
to the failing disk. With UNC sector remapping in disk firmware, btrfs
could even repair the UNC sector so the disk is no longer failing.
The only hint would be "Reallocated sector count" in SMART stats- -and
only if you are lucky enough to have that count reported accurately by
your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't
happen to read that particular block from that particular mirror. btrfs check won't verify the contents of every mirror are correct--that
is what scrub is for. If btrfs check passes, it means at least one
usable copy has been found for every metadata page in the filesystem.
Scrub can handle all remaining errors.Quoted 7 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see
https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtQuoted 7 lines
Not sure what to do next, so seeking your advice! The important data
on the drive is backed up, and I'll be running a verify to see if
there are any corruptions overnight. Would still like to try to save
the filesystem if possible though.Replace the disk as usual. There's no indication of unrecoverable
metadata failure. btrfs found some damage on the failing disk, but
repaired it automatically.Run 'btrfs replace' to reconstruct the content of the failing drive
on the new one. Run a scrub after that's done to make sure all errors
were corrected (or identify damaged raid6 data blocks if they were
not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace -r'
to prefer to read from other disks, and only use the failing disk as
a last resort. Don't try too hard--a failing disk is a failing disk,
so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/btrfs replace may hang a few times during recovery. Reboot to work
around
that bug (btrfs-replace-wrong-state-after-exit and btrfs-replace- lockup).Quoted 439 lines
You may lose a few data blocks here and there (a "few" meaning about
"one in ten thousand corrupted blocks"). You can identify which data
blocks using scrub, or simply try to read all files and note any IO errors encountered. Delete the broken files and replace their content from backups to work around that bug (read-repair- failure,
parity-update-failure).Quoted 428 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match] bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936 sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|BIG_METADATA|EXTENDED_IREF|
RAID56 |
SKINNY_METADATA|
RAID1C34 ) cache_generation 368950
uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016 dev_item.bytes_used 6774245556224 dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096num_stripes4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349
stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675
stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb
stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7
backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd
1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd
0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected:ino 0
off 12886944968704 (dev/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical
blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off
[ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk
[ 13.368410] BTRFS: device label homedirs devid 2 transid 367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error) [248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>) [248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>) [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>) [248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>) [248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>) [248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>) [248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>) [248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>) [248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>) [248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writing primarysuper block to device 3
Quoted 71 lines · Bas Hulsken
Quoted 64 lines · Zygo Blaxell
Quoted 42 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array (the
drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device, not
on the filesystem), but with bad results again. The drive is basically
still not responsive after the first error, this is the error according
to smartctl:Error 4 occurred at disk power-on lifetime: 7124 hours (296 days + 20
hours)
When the command that caused the error occurred, the device was active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUEDThe other errors are all the same (Error: UNC at LBA =
0x00002468= 9320), and at exactly the same LBA, once scrub gets to this LBA, the
drives basically no longer responds, and querying it with smartctl will
return garbage characters, or nothing at all. I've attached a dmesg with also the io errors this time.Quoted 2 lines
So: I conclude scub is not going to fix this problem, and I should really replace the disk.
Agreed. It is now properly configured, there are UNC sectors logged in
SMART, and UNC recovery is still not working. The drive is broken and
will likely stay that way.Quoted 5 lines
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing
disk if at least 2 other disks are failing at that spot (given it's raid6), correct?That's the general idea.
Quoted 3 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the disk, it will just crash again and ruin my replace.
Quoted 5 lines
There's still another redundant disk in the array, so there's no need to
put too much effort into recovering one failing drive. The disk seems
really broken, so take it offline and do a replace in degraded mode.
Quoted 6 lines
Thanks for the clear help and explanations, I have 2 final questions (famous last words :-) )
1) In your earlier reply you mentioned known bugs, including the "Spurious read errors in btrfs raid5 degraded mode". Would replacing with "-r" while the faulty drive is still online not prevent this from happening?
The bug only seems to affect kernel read code, which tries to avoid unnecessary reads so it has a lot of special cases (not degraded, degraded, P corrupted, Q corrupted...). Scrub uses different code which is much simpler, always reads the entire stripe at once, and doesn't seem to be affected by the read bug. Replace is implemented as a special case of scrub internally, so it has the same read behavior as scrub.
In testing I've always hit the spurious read failures with reads and never with scrub or replace.
Quoted 1 line
Assuming the replace speed is similar to the scrub speed,
Replace speed will be the same as the scrub speed _for scrub on one drive_.
Running scrub on all disks at once will dramatically reduce performance compared to running scrub on a single disk (or even each disk one at a time). If you have been running scrub with a mountpoint argument instead of individual devices, then it has been running scrubs on all disks in parallel (i.e. competing with each other), and taking far longer than it could have.
Quoted 3 lines
I'm looking at 4 days to replace the drive, would prefer if I could keep using the filesystem while that happens.. otherwise wiping it and restoring from backup might actually be the fastest option.
I would avoid using it as much as possible during the replace. I have tested running raid5 in degraded mode with a fully active read/write workload, and there were a handful of lost data blocks (17, 84K) on a 20TB restore. I don't know if the extra Q disk for raid6 helps, raid6 is not something I'm testing so far.
Quoted 4 lines
2) If I go the offline way, how would I actually do that? I do not see a command in the btrfs manual to flag a disk as faulty, or any other command to move into "degraded" mode. I could unplug it while power off ofcourse, is that the best / only way?
That, or 'echo 1 > /sys/block/sdd/device/delete'. Mount with -o degraded to allow the filesystem to be read-write while degraded.
btrfs does not have a "forcibly evict a drive" feature of its own, but it will remove a drive if the kernel tells it the drive is gone. It's one of the conspicuously missing features from the multi-device admin interface.
Quoted 2,403 lines
Quoted 2,401 lines
Quoted 2,400 lines
thanks!
Quoted 222 lines · Zygo Blaxell
Quoted 7 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting
"transid verify failed" errors on my btrfs filesystem (see attached
dmesg | grep -i btrfs dump in btrfs_dmesg.txt).Scary! But in this case, it looks like they were automatically recovered
already.Quoted 8 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try
that again (happened 3 times now, and was the root cause of the transid
verify failed errors possibly, at least they did not show up earlier
than the failed scrub).That is quite common when disks fail. The extra IO load results in a
firmware crash, either due to failure of the electronics disrupting the
embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly.
Any unflushed writes in the write cache at this time are lost. Lost
metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC
controls, so they have very long IO error retry loops (2 minutes).
That can look like an intermittent failure in the logs, but in fact
it's
an ordinary remappable UNC sector. The kernel has a default timeout
of 30 seconds, so the kernel forces a drive reset before the drive can
report the bad block. The drive can often be used normally by setting
the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full
minutes before reporting an IO error is a separate question, but this
is a feature of several popular cheap drive models, and you _can_ use
these disks if needed.Quoted 9 lines
A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem
with errors. There was never a crash/power failure, so the filesystem
was unmounted at every reboot, but as said on 3 occasions (after a
scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once (more
precisely, "not more than N - 1 times for a RAID profile with
N copies"), and2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 17 lines
[38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected:Quoted 3 lines
ino 0
off 12884760735744 (dev/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are
btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery from
a disk failure.The failing disk will not be keeping up with metadata updates (because
it's failing, you can't assume it will be doing anything correctly).
Writes will be lost on sdd that are not lost on the other mirror drives.
btrfs will continue without error as long as at least one mirror drive
is OK. btrfs will notice during later reads that some metadata pages
are not up to date on the failing disk, and correct the failing disk
using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is
part of the cost of nodatacow--no recovery from data corruption errors.Quoted 7 lines
Funnily enough, after a reboot every time the filesystem gets mounted
without issues (the unresponsive drive is back online), and btrfs
check --readonly claims the filesystem has no errors (see attached
btrfs_sdd_check.txt).There's no error on the disk by the time you run btrfs check or reboot
and
mount again. "read error corrected" means correct data was written
back
to the failing disk. With UNC sector remapping in disk firmware, btrfs
could even repair the UNC sector so the disk is no longer failing.
The only hint would be "Reallocated sector count" in SMART stats- -and
only if you are lucky enough to have that count reported accurately by
your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't
happen to read that particular block from that particular mirror. btrfs check won't verify the contents of every mirror are correct--that
is what scrub is for. If btrfs check passes, it means at least one
usable copy has been found for every metadata page in the filesystem.
Scrub can handle all remaining errors.Quoted 7 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see
https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtQuoted 7 lines
Not sure what to do next, so seeking your advice! The important data
on the drive is backed up, and I'll be running a verify to see if
there are any corruptions overnight. Would still like to try to save
the filesystem if possible though.Replace the disk as usual. There's no indication of unrecoverable
metadata failure. btrfs found some damage on the failing disk, but
repaired it automatically.Run 'btrfs replace' to reconstruct the content of the failing drive
on the new one. Run a scrub after that's done to make sure all errors
were corrected (or identify damaged raid6 data blocks if they were
not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace -r'
to prefer to read from other disks, and only use the failing disk as
a last resort. Don't try too hard--a failing disk is a failing disk,
so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/btrfs replace may hang a few times during recovery. Reboot to work
around
that bug (btrfs-replace-wrong-state-after-exit and btrfs-replace- lockup).Quoted 439 lines
You may lose a few data blocks here and there (a "few" meaning about
"one in ten thousand corrupted blocks"). You can identify which data
blocks using scrub, or simply try to read all files and note any IO errors encountered. Delete the broken files and replace their content from backups to work around that bug (read-repair- failure,
parity-update-failure).Quoted 428 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match] bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936 sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|BIG_METADATA|EXTENDED_IREF|
RAID56 |
SKINNY_METADATA|
RAID1C34 ) cache_generation 368950
uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016 dev_item.bytes_used 6774245556224 dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096num_stripes4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349
stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675
stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb
stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7
backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd
1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd
0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected:ino 0
off 12886944968704 (dev/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical
blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off
[ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk
[ 13.368410] BTRFS: device label homedirs devid 2 transid 367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error) [248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>) [248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>) [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>) [248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>) [248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>) [248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>) [248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>) [248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>) [248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>) [248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writing primarysuper block to device 3
Quoted 139 lines · Zygo Blaxell
Quoted 83 lines · Bas Hulsken
Quoted 74 lines · Zygo Blaxell
Quoted 48 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array
(the
drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device,
not
on the filesystem), but with bad results again. The drive is basically
still not responsive after the first error, this is the error according
to smartctl:Error 4 occurred at disk power-on lifetime: 7124 hours (296 days +
20
hours)
When the command that caused the error occurred, the device was active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUEDThe other errors are all the same (Error: UNC at LBA =
0x00002468=
9320), and at exactly the same LBA, once scrub gets to this LBA, the
drives basically no longer responds, and querying it with smartctl
will
return garbage characters, or nothing at all. I've attached a dmesg
with also the io errors this time.Quoted 3 lines
So: I conclude scub is not going to fix this problem, and I should
really replace the disk.Agreed. It is now properly configured, there are UNC sectors logged
in
SMART, and UNC recovery is still not working. The drive is broken and
will likely stay that way.Quoted 6 lines
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing
disk if at least 2 other disks are failing at that spot (given it's
raid6), correct?That's the general idea.
Quoted 4 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the
disk, it will just crash again and ruin my replace.Quoted 7 lines
There's still another redundant disk in the array, so there's no need
to
put too much effort into recovering one failing drive. The disk seems
really broken, so take it offline and do a replace in degraded mode.Quoted 7 lines
Thanks for the clear help and explanations, I have 2 final questions (famous last words :-) )
1) In your earlier reply you mentioned known bugs, including the "Spurious read errors in btrfs raid5 degraded mode". Would replacing with "-r" while the faulty drive is still online not prevent this from
happening?The bug only seems to affect kernel read code, which tries to avoid unnecessary reads so it has a lot of special cases (not degraded, degraded, P corrupted, Q corrupted...). Scrub uses different code which
is much simpler, always reads the entire stripe at once, and doesn't seem to be affected by the read bug. Replace is implemented as a special
case of scrub internally, so it has the same read behavior as scrub.In testing I've always hit the spurious read failures with reads and never with scrub or replace.
Quoted 1 line
Assuming the replace speed is similar to the scrub speed,
Replace speed will be the same as the scrub speed
_forscrub on onedrive_.Running scrub on all disks at once will dramatically reduce performance compared to running scrub on a single disk (or even each disk one at a time). If you have been running scrub with a mountpoint argument instead of individual devices, then it has been running scrubs on all disks in parallel (i.e. competing with each other), and taking far longer
than it could have.Quoted 4 lines
I'm looking at 4 days to replace the drive, would prefer if I could keep using the filesystem while that happens.. otherwise wiping it and
restoring from backup might actually be the fastest option.I would avoid using it as much as possible during the replace. I have tested running raid5 in degraded mode with a fully active read/write workload, and there were a handful of lost data blocks (17, 84K) on a 20TB restore. I don't know if the extra Q disk for raid6 helps, raid6 is not something I'm testing so far.
Quoted 6 lines
2) If I go the offline way, how would I actually do that? I do not see
a command in the btrfs manual to flag a disk as faulty, or any other command to move into "degraded" mode. I could unplug it while power off
ofcourse, is that the best / only way?That, or 'echo 1 > /sys/block/sdd/device/delete'. Mount with -o degraded
to allow the filesystem to be read-write while degraded.
Quoted 7 lines
btrfs does not have a "forcibly evict a drive" feature of its own, but it
will remove a drive if the kernel tells it the drive is gone. It's one of
the conspicuously missing features from the multi-device admin interface.
Started the replace I courageously (or foolishly, we'll see) decided to do it on the mounted filesystem.
I issued this command (with /dev/sde the faulty but online disk, and /dev/sdb the new one):
sudo btrfs replace start -r /dev/sde /dev/sdb /home
I immediately found some funny behaviour, that may be bugs, or my misunderstanding of the tools/ btrfs.
1) the io load shows that inspite of '-r' the drive replaced (sde) is seeing the same amount of reads as the other drives in the array. That's not what I expected reading the btrfs replace man-page. This is the output of 'pcp dstat --disk -D total,sdb,sde,sdf,sdh,sdd'
--dsk/sdb-----dsk/sdd-----dsk/sde-----dsk/sdf-----dsk/sdh----dsk/total-
read writ: read writ: read writ: read writ: read writ: read writ
0 52M: 41M 0 : 55M 0 : 43M 0 : 52M 0 : 191M 52M 0 66M: 48M 0 : 63M 0 : 47M 0 : 67M 0 : 225M 66M 0 66M: 49M 64k: 66M 68k: 49M 64k: 64M 128k: 228M 67M 0 67M: 51M 0 : 67M 0 : 51M 0 : 68M 0 : 237M 67M 0 75M: 57M 0 : 75M 0 : 57M 0 : 76M 0 : 265M 75M 0 71M: 53M 0 : 71M 0 : 50M 0 : 71M 0 : 244M 71M 0 45M: 30M 6459k: 39M 6188k: 31M 6555k: 39M 6827k: 139M 71M 0 35M: 27M 12k: 35M 12k: 27M 12k: 36M 12k: 125M 35M 0 54M: 41M 0 : 53M 0 : 40M 0 : 53M 0 : 187M 54M 0 66M: 50M 0 : 66M 0 : 49M 0 : 66M 0 : 232M 66M 0 64M: 47M 0 : 63M 0 : 47M 0 : 64M 0 : 221M 64M 0 68M: 51M 0 : 69M 0 : 52M 0 : 69M 0 : 240M 68M 0 73M: 56M 0 : 74M 0 : 56M 0 : 74M 0 : 261M 73M
2) the scrub status for the faulty drive (I cancelled the scrub) show that the scrub is actually running. This scared me for a bit, I though I forgot to cancel the scrub before running replace, but I looked at my command history and I actually did cancel it. Also the "Duration' in the status report is not increasing. Seems a bug? This is the output of 'sudo btrfs scrub status /dev/sde', sde being the faulty disk
UUID: fce03447-ad88-4891-b91f-390665fcd5e7 Scrub started: Tue Mar 30 13:42:36 2021 Status: running Duration: 0:06:42 Time left: 130:24:00 ETA: Tue Apr 6 21:48:55 2021 Total to scrub: 12.28TiB Bytes scrubbed: 10.76GiB (0.09%) Rate: 27.40MiB/s Error summary: csum=24 Corrected: 23 Uncorrectable: 1 Unverified: 0
Things might crash when I reach the LBA with the problem on the faulty disk, we'll see.
In addition, I noticed that the replace command runs at about twice the speed as the scrub, but the systemload is much higher. I guess scrub is a lower ionice priority than replace.
Quoted 2,654 lines
Quoted 2,654 lines
Quoted 2,652 lines
Quoted 2,651 lines
thanks!
Quoted 243 lines · Zygo Blaxell
Quoted 7 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting
"transid verify failed" errors on my btrfs filesystem (see attached
dmesg | grep -i btrfs dump in btrfs_dmesg.txt).Scary! But in this case, it looks like they were automatically recovered
already.Quoted 9 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try
that again (happened 3 times now, and was the root cause of the
transid
verify failed errors possibly, at least they did not show up earlier
than the failed scrub).That is quite common when disks fail. The extra IO load results
in a
firmware crash, either due to failure of the electronics disrupting the
embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly.
Any unflushed writes in the write cache at this time are lost. Lost
metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC
controls, so they have very long IO error retry loops (2 minutes).
That can look like an intermittent failure in the logs, but in fact
it's
an ordinary remappable UNC sector. The kernel has a default timeout
of 30 seconds, so the kernel forces a drive reset before the drive can
report the bad block. The drive can often be used normally by setting
the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full
minutes before reporting an IO error is a separate question, but
this
is a feature of several popular cheap drive models, and you _can_
use
these disks if needed.Quoted 9 lines
A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem
with errors. There was never a crash/power failure, so the filesystem
was unmounted at every reboot, but as said on 3 occasions (after a
scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once
(more
precisely, "not more than N - 1 times for a RAID profile
with
N copies"), and2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 18 lines
[38079.437411] BTRFS error (device sdg): parent transidverify
failed
on 12884760723456 wanted 360620 found
359101[38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected:Quoted 3 lines
ino 0
off 12884760735744 (dev/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on
amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are
btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery
from
a disk failure.The failing disk will not be keeping up with metadata updates (because
it's failing, you can't assume it will be doing anything correctly).
Writes will be lost on sdd that are not lost on the other mirror
drives.
btrfs will continue without error as long as at least one mirror
drive
is OK. btrfs will notice during later reads that some metadata pages
are not up to date on the failing disk, and correct the failing disk
using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is
part of the cost of nodatacow--no recovery from data corruption errors.Quoted 7 lines
Funnily enough, after a reboot every time the filesystem gets mounted
without issues (the unresponsive drive is back online), and btrfs
check --readonly claims the filesystem has no errors (see attached
btrfs_sdd_check.txt).There's no error on the disk by the time you run btrfs check or reboot
and
mount again. "read error corrected" means correct data was written
back
to the failing disk. With UNC sector remapping in disk firmware,
btrfs
could even repair the UNC sector so the disk is no longer failing.
The only hint would be "Reallocated sector count" in SMART stats-
-and
only if you are lucky enough to have that count reported accurately by
your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't
happen to read that particular block from that particular mirror.
btrfs check won't verify the contents of every mirror are correct--that
is what scrub is for. If btrfs check passes, it means at least one
usable copy has been found for every metadata page in the filesystem.
Scrub can handle all remaining errors.Quoted 7 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see
https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtQuoted 10 lines
Not sure what to do next, so seeking your advice! The important
data
on the drive is backed up, and I'll be running a verify to see
if
there are any corruptions overnight. Would still like to try to
save
the filesystem if possible though.Replace the disk as usual. There's no indication of unrecoverable
metadata failure. btrfs found some damage on the failing disk, but
repaired it automatically.Run 'btrfs replace' to reconstruct the content of the failing drive
on the new one. Run a scrub after that's done to make sure all errors
were corrected (or identify damaged raid6 data blocks if they were
not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace
-r'
to prefer to read from other disks, and only use the failing disk
as
a last resort. Don't try too hard--a failing disk is a failing disk,
so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/btrfs replace may hang a few times during recovery. Reboot to work
around
that bug (btrfs-replace-wrong-state-after-exit and btrfs- replace-
lockup).Quoted 476 lines
You may lose a few data blocks here and there (a "few" meaning about
"one in ten thousand corrupted blocks"). You can identify which
data
blocks using scrub, or simply try to read all files and note any
IO errors encountered. Delete the broken files and replace their
content from backups to work around that bug (read-repair- failure,
parity-update-failure).Quoted 462 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match] bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936 sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|BIG_METADATA|EXTENDED_IREF|
RAID56 |
SKINNY_METADATA| RAID1C34 ) cache_generation 368950 uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016 dev_item.bytes_used 6774245556224 dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096
num_stripes 4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349
stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675
stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb
stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7
backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs:
wr
0, rd
1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs:
wr
0, rd
0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs:
wr
74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected:ino 0
off 12886944968704 (dev/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical
blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off
[ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk
[ 13.368410] BTRFS: device label homedirs devid 2 transid 367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error) [248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>) [248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>) [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>) [248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>) [248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>) [248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>) [248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>) [248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>) [248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>) [248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writing primarysuper block to device 3
Quoted 165 lines · Bas Hulsken
Quoted 139 lines · Zygo Blaxell
Quoted 83 lines · Bas Hulsken
Quoted 74 lines · Zygo Blaxell
Quoted 48 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array
(the
drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device,
not
on the filesystem), but with bad results again. The drive is basically
still not responsive after the first error, this is the error according
to smartctl:Error 4 occurred at disk power-on lifetime: 7124 hours (296 days +
20
hours)
When the command that caused the error occurred, the device was active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED 60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED 60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED 60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED 60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUEDThe other errors are all the same (Error: UNC at LBA =
0x00002468=
9320), and at exactly the same LBA, once scrub gets to this LBA, the
drives basically no longer responds, and querying it with smartctl
will
return garbage characters, or nothing at all. I've attached a dmesg
with also the io errors this time.Quoted 3 lines
So: I conclude scub is not going to fix this problem, and I should
really replace the disk.Agreed. It is now properly configured, there are UNC sectors logged
in
SMART, and UNC recovery is still not working. The drive is broken and
will likely stay that way.Quoted 6 lines
@Zygo: following your advice, and using btrfs replace -r with the failing drive online, I take it it reads only sectors from the failing
disk if at least 2 other disks are failing at that spot (given it's
raid6), correct?That's the general idea.
Quoted 4 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from the
disk, it will just crash again and ruin my replace.Quoted 7 lines
There's still another redundant disk in the array, so there's no need
to
put too much effort into recovering one failing drive. The disk seems
really broken, so take it offline and do a replace in degraded mode.Quoted 7 lines
Thanks for the clear help and explanations, I have 2 final questions (famous last words :-) )
1) In your earlier reply you mentioned known bugs, including the "Spurious read errors in btrfs raid5 degraded mode". Would replacing with "-r" while the faulty drive is still online not prevent this from
happening?The bug only seems to affect kernel read code, which tries to avoid unnecessary reads so it has a lot of special cases (not degraded, degraded, P corrupted, Q corrupted...). Scrub uses different code which
is much simpler, always reads the entire stripe at once, and doesn't seem to be affected by the read bug. Replace is implemented as a special
case of scrub internally, so it has the same read behavior as scrub.In testing I've always hit the spurious read failures with reads and never with scrub or replace.
Quoted 1 line
Assuming the replace speed is similar to the scrub speed,
Replace speed will be the same as the scrub speed
_forscrub on onedrive_.Running scrub on all disks at once will dramatically reduce performance compared to running scrub on a single disk (or even each disk one at a time). If you have been running scrub with a mountpoint argument instead of individual devices, then it has been running scrubs on all disks in parallel (i.e. competing with each other), and taking far longer
than it could have.Quoted 4 lines
I'm looking at 4 days to replace the drive, would prefer if I could keep using the filesystem while that happens.. otherwise wiping it and
restoring from backup might actually be the fastest option.I would avoid using it as much as possible during the replace. I have tested running raid5 in degraded mode with a fully active read/write workload, and there were a handful of lost data blocks (17, 84K) on a 20TB restore. I don't know if the extra Q disk for raid6 helps, raid6 is not something I'm testing so far.
Quoted 6 lines
2) If I go the offline way, how would I actually do that? I do not see
a command in the btrfs manual to flag a disk as faulty, or any other command to move into "degraded" mode. I could unplug it while power off
ofcourse, is that the best / only way?That, or 'echo 1 > /sys/block/sdd/device/delete'. Mount with -o degraded
to allow the filesystem to be read-write while degraded.Quoted 7 lines
btrfs does not have a "forcibly evict a drive" feature of its own, but it
will remove a drive if the kernel tells it the drive is gone. It's one of
the conspicuously missing features from the multi-device admin interface.Started the replace I courageously (or foolishly, we'll see) decided to do it on the mounted filesystem.
I issued this command (with
/dev/sdethe faulty but online disk, and/dev/sdbthe new one):sudo btrfs replace start -r
/dev/sde/dev/sdb/homeI immediately found some funny behaviour, that may be bugs, or my misunderstanding of the
tools/btrfs.
1) the io load shows that inspite of '-r' the drive replaced (sde) is seeing the same amount of reads as the other drives in the array. That's not what I expected reading the btrfs replace man-page. This is the output of 'pcp dstat --disk -D total,sdb,sde,sdf,sdh,sdd'--dsk/sdb-----dsk/sdd-----dsk/sde-----dsk/sdf-----dsk/sdh----dsk/total-
read writ: read writ: read writ: read writ: read writ: read writ
Quoted 13 lines
0 52M: 41M 0 : 55M 0 : 43M 0 : 52M 0 : 191M 52M 0 66M: 48M 0 : 63M 0 : 47M 0 : 67M 0 : 225M 66M 0 66M: 49M 64k: 66M 68k: 49M 64k: 64M 128k: 228M 67M 0 67M: 51M 0 : 67M 0 : 51M 0 : 68M 0 : 237M 67M 0 75M: 57M 0 : 75M 0 : 57M 0 : 76M 0 : 265M 75M 0 71M: 53M 0 : 71M 0 : 50M 0 : 71M 0 : 244M 71M 0 45M: 30M 6459k: 39M 6188k: 31M 6555k: 39M 6827k: 139M 71M 0 35M: 27M 12k: 35M 12k: 27M 12k: 36M 12k: 125M 35M 0 54M: 41M 0 : 53M 0 : 40M 0 : 53M 0 : 187M 54M 0 66M: 50M 0 : 66M 0 : 49M 0 : 66M 0 : 232M 66M 0 64M: 47M 0 : 63M 0 : 47M 0 : 64M 0 : 221M 64M 0 68M: 51M 0 : 69M 0 : 52M 0 : 69M 0 : 240M 68M 0 73M: 56M 0 : 74M 0 : 56M 0 : 74M 0 : 261M 73M
That might be due to raid6. Scrub is not well adapted for the parity RAID levels. Another bug to add to the list...
Quoted 5 lines
2) the scrub status for the faulty drive (I cancelled the scrub) show that the scrub is actually running. This scared me for a bit, I though I forgot to cancel the scrub before running replace, but I looked at my command history and I actually did cancel it. Also the "Duration' in the status report is not increasing. Seems a bug?
Yeah, scrub and replace share so much of their implementation that the scrub tools can get confused by traces of replace state. A scrub cancel will even cancel a replace.
Quoted 2,681 lines
This is the output of
'sudo btrfs scrub status/dev/sde', sde being the faulty diskUUID: fce03447-ad88-4891-b91f-390665fcd5e7 Scrub started: Tue Mar 30 13:42:36 2021 Status: running Duration: 0:06:42 Time left: 130:24:00 ETA: Tue Apr 6 21:48:55 2021 Total to scrub: 12.28TiB Bytes scrubbed: 10.76GiB (0.09%) Rate: 27.40MiB/s Error summary: csum=24 Corrected: 23 Uncorrectable: 1 Unverified: 0Things might crash when I reach the LBA with the problem on the faulty disk, we'll see.
In addition, I noticed that the replace command runs at about twice the speed as the scrub, but the systemload is much higher. I guess scrub is a lower ionice priority than replace.
Quoted 2,654 lines
Quoted 2,654 lines
Quoted 2,652 lines
Quoted 2,651 lines
thanks!
Quoted 243 lines · Zygo Blaxell
Quoted 7 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm getting
"transid verify failed" errors on my btrfs filesystem (see attached
dmesg | grep -i btrfs dump in btrfs_dmesg.txt).Scary! But in this case, it looks like they were automatically recovered
already.Quoted 9 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant to try
that again (happened 3 times now, and was the root cause of the
transid
verify failed errors possibly, at least they did not show up earlier
than the failed scrub).That is quite common when disks fail. The extra IO load results
in a
firmware crash, either due to failure of the electronics disrupting the
embedded CPU so it can't run any program correctly, or an error condition
in the rest of the disk that the firmware doesn't handle properly.
Any unflushed writes in the write cache at this time are lost. Lost
metadata writes will result in parent transid verify failures later on.Low end desktop drives have very large SCTERC timeouts but no SCTERC
controls, so they have very long IO error retry loops (2 minutes).
That can look like an intermittent failure in the logs, but in fact
it's
an ordinary remappable UNC sector. The kernel has a default timeout
of 30 seconds, so the kernel forces a drive reset before the drive can
report the bad block. The drive can often be used normally by setting
the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two full
minutes before reporting an IO error is a separate question, but
this
is a feature of several popular cheap drive models, and you _can_
use
these disks if needed.Quoted 9 lines
A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem
with errors. There was never a crash/power failure, so the filesystem
was unmounted at every reboot, but as said on 3 occasions (after a
scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once
(more
precisely, "not more than N - 1 times for a RAID profile
with
N copies"), and2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 18 lines
[38079.437411] BTRFS error (device sdg): parent transidverify
failed
on 12884760723456 wanted 360620 found
359101[38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected:Quoted 3 lines
ino 0
off 12884760735744 (dev/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K on
amd64/x86/arm/aarch64, so these 4 "read error corrected" lines are
btrfs
replacing one broken metadata page on sdd using data from other mirrors.If you are using raid1* metadata, this is part of normal recovery
from
a disk failure.The failing disk will not be keeping up with metadata updates (because
it's failing, you can't assume it will be doing anything correctly).
Writes will be lost on sdd that are not lost on the other mirror
drives.
btrfs will continue without error as long as at least one mirror
drive
is OK. btrfs will notice during later reads that some metadata pages
are not up to date on the failing disk, and correct the failing disk
using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted. That is
part of the cost of nodatacow--no recovery from data corruption errors.Quoted 7 lines
Funnily enough, after a reboot every time the filesystem gets mounted
without issues (the unresponsive drive is back online), and btrfs
check --readonly claims the filesystem has no errors (see attached
btrfs_sdd_check.txt).There's no error on the disk by the time you run btrfs check or reboot
and
mount again. "read error corrected" means correct data was written
back
to the failing disk. With UNC sector remapping in disk firmware,
btrfs
could even repair the UNC sector so the disk is no longer failing.
The only hint would be "Reallocated sector count" in SMART stats-
-and
only if you are lucky enough to have that count reported accurately by
your drive firmware.Possibly there are still error errors on disk, but btrfs check didn't
happen to read that particular block from that particular mirror.
btrfs check won't verify the contents of every mirror are correct--that
is what scrub is for. If btrfs check passes, it means at least one
usable copy has been found for every metadata page in the filesystem.
Scrub can handle all remaining errors.Quoted 7 lines
There are 20 unique "transid very failed" errors, I've dumped all the blocks, but that file is too large to attach here, see
https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtQuoted 10 lines
Not sure what to do next, so seeking your advice! The important
data
on the drive is backed up, and I'll be running a verify to see
if
there are any corruptions overnight. Would still like to try to
save
the filesystem if possible though.Replace the disk as usual. There's no indication of unrecoverable
metadata failure. btrfs found some damage on the failing disk, but
repaired it automatically.Run 'btrfs replace' to reconstruct the content of the failing drive
on the new one. Run a scrub after that's done to make sure all errors
were corrected (or identify damaged raid6 data blocks if they were
not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace operation,
in case there are errors on other disks too. Use 'btrfs replace
-r'
to prefer to read from other disks, and only use the failing disk
as
a last resort. Don't try too hard--a failing disk is a failing disk,
so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/btrfs replace may hang a few times during recovery. Reboot to work
around
that bug (btrfs-replace-wrong-state-after-exit and btrfs- replace-
lockup).Quoted 476 lines
You may lose a few data blocks here and there (a "few" meaning about
"one in ten thousand corrupted blocks"). You can identify which
data
blocks using scrub, or simply try to read all files and note any
IO errors encountered. Delete the broken files and replace their
content from backups to work around that bug (read-repair- failure,
parity-update-failure).Quoted 462 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match] bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7 metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7 label homedirs
generation 368950
root 12883568295936 sys_array_size 193
chunk_root_generation 367570
root_level 1
chunk_root 23134208
chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064
bytes_used 13410457739264
sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|BIG_METADATA|EXTENDED_IREF|
RAID56 |
SKINNY_METADATA| RAID1C34 ) cache_generation 368950 uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7 [match]
dev_item.type 0
dev_item.total_bytes 8001563222016 dev_item.bytes_used 6774245556224 dev_item.io_align 4096
dev_item.io_width 4096
dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096
num_stripes 4sub_stripes1
stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349
stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675
stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb
stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7
backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 gen:
368949 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883562348544 gen:
368949 level: 2
backup_fs_root: 12883557957632 gen:
368949 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883558776832 gen:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 gen:
368950 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883566575616 gen:
368950 level: 2
backup_fs_root: 12883559759872 gen:
368950 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883560382464 gen:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 gen:
368947 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883563347968 gen:
368947 level: 2
backup_fs_root: 12883555663872 gen:
368947 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883562217472 gen:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 gen:
368948 level: 1
backup_chunk_root: 23134208 gen:
367570 level: 1
backup_extent_root: 12883559759872 gen:
368948 level: 2
backup_fs_root: 12883553746944 gen:
368948 level: 2
backup_dev_root: 12883678691328 gen:
367580 level: 1
backup_csum_root: 12883555434496 gen:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206
/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs:
wr
0, rd
1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs:
wr
0, rd
0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs:
wr
74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected:ino 0
off 12886944968704 (dev/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7
found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical
blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off
[ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk
[ 13.368410] BTRFS: device label homedirs devid 2 transid 367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs: wr 0, rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs: wr 0, rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs: wr 74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd 60/80:00:80:25:00/00:00:89:00:00/40 tag 0 ncq dma 65536 in res 43/40:00:68:24:00/00:00:89:00:00/40 Emask 0x9 (media error) [248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd 60/80:00:80:27:00/00:00:89:00:00/40 tag 1 ncq dma 65536 in res 43/04:08:80:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd 60/80:00:00:17:00/00:00:89:00:00/40 tag 2 ncq dma 65536 in res 43/04:10:00:17:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd 60/80:00:00:19:00/00:00:89:00:00/40 tag 3 ncq dma 65536 in res 43/04:18:00:19:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd 60/80:00:00:1b:00/00:00:89:00:00/40 tag 4 ncq dma 65536 in res 43/04:20:00:1b:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd 60/80:00:00:1d:00/00:00:89:00:00/40 tag 5 ncq dma 65536 in res 43/04:28:00:1d:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd 60/80:00:00:1f:00/00:00:89:00:00/40 tag 6 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd 60/80:00:00:21:00/00:00:89:00:00/40 tag 7 ncq dma 65536 in res 43/04:38:00:21:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd 60/80:00:00:23:00/00:00:89:00:00/40 tag 8 ncq dma 65536 in res 43/04:40:00:23:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd 60/80:00:00:25:00/00:00:89:00:00/40 tag 9 ncq dma 65536 in res 43/04:48:00:25:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd 60/80:00:00:27:00/00:00:89:00:00/40 tag 10 ncq dma 65536 in res 43/04:50:00:27:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd 60/80:00:80:29:00/00:00:89:00:00/40 tag 11 ncq dma 65536 in res 43/04:58:80:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd 60/80:00:00:29:00/00:00:89:00:00/40 tag 12 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x1 (device error) [248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd 60/00:00:00:24:00/01:00:89:00:00/40 tag 19 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd 60/00:00:00:26:00/01:00:89:00:00/40 tag 20 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd 60/00:00:00:28:00/01:00:89:00:00/40 tag 22 ncq dma 131072 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd 60/80:00:80:17:00/00:00:89:00:00/40 tag 25 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd 60/80:00:80:19:00/00:00:89:00:00/40 tag 26 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd 60/80:00:80:1b:00/00:00:89:00:00/40 tag 27 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd 60/80:00:80:1d:00/00:00:89:00:00/40 tag 28 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd 60/80:00:80:1f:00/00:00:89:00:00/40 tag 29 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd 60/80:00:80:21:00/00:00:89:00:00/40 tag 30 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd 60/80:00:80:23:00/00:00:89:00:00/40 tag 31 ncq dma 65536 in res 43/04:60:00:29:00/00:00:89:00:00/40 Emask 0x5 (timeout) [248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error at logical 2347222237184 on dev /dev/sdd, physical 1176826544128, root 5, inode 1119818, offset 1004863488, length 4096, links 1 (path: <REMOVED>) [248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347223810048 on dev /dev/sdd, physical 1176827330560, root 5, inode 1119818, offset 1006436352, length 4096, links 1 (path: <REMOVED>) [248241.157957] BTRFS warning (device sdg): i/o error at logical 2347224858624 on dev /dev/sdd, physical 1176827854848, root 5, inode 1119818, offset 1007484928, length 4096, links 1 (path: <REMOVED>) [248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error at logical 2347223285760 on dev /dev/sdd, physical 1176827068416, root 5, inode 1119818, offset 1005912064, length 4096, links 1 (path: <REMOVED>) [248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error at logical 2347222761472 on dev /dev/sdd, physical 1176826806272, root 5, inode 1119818, offset 1005387776, length 4096, links 1 (path: <REMOVED>) [248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error at logical 2347223351296 on dev /dev/sdd, physical 1176827133952, root 5, inode 1119818, offset 1005977600, length 4096, links 1 (path: <REMOVED>) [248241.199945] BTRFS warning (device sdg): i/o error at logical 2347222302720 on dev /dev/sdd, physical 1176826609664, root 5, inode 1119818, offset 1004929024, length 4096, links 1 (path: <REMOVED>) [248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error at logical 2347224924160 on dev /dev/sdd, physical 1176827920384, root 5, inode 1119818, offset 1007550464, length 4096, links 1 (path: <REMOVED>) [248241.201048] BTRFS warning (device sdg): i/o error at logical 2347222827008 on dev /dev/sdd, physical 1176826871808, root 5, inode 1119818, offset 1005453312, length 4096, links 1 (path: <REMOVED>) [248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writing primarysuper block to device 3
Quoted 245 lines · Zygo Blaxell
Quoted 224 lines · Bas Hulsken
Quoted 174 lines · Zygo Blaxell
Quoted 101 lines · Bas Hulsken
Quoted 90 lines · Zygo Blaxell
Quoted 59 lines · Bas Hulsken
I followed your advice, Zygo and Chris, and did both:
1) smartctl -l scterc,70,70/dev/sdXfor all 4 drives in the array
(the
drives do support this)
2) echo 180 >/sys/block/sdX/device/timeoutfor all 4 driveswith that I attempted another scrub (on the single failing device,
not
on the filesystem), but with bad results again. The drive is basically
still not responsive after the first error, this is the error according
to smartctl:Error 4 occurred at disk power-on lifetime: 7124 hours (296 days
+
20
hours)
When the command that caused the error occurred, the device was
active or idle.After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 41 98 68 24 00 40 Error: UNC at LBA =0x00002468= 9320Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DCPowered_Up_TimeCommand/Feature_Name
-- -- -- -- -- -- -- -- ---------------- ----------------
----
60 80 00 80 25 00 40 00 2d+20:57:19.109 READ FPDMA QUEUED
60 80 f8 80 23 00 40 00 2d+20:57:16.423 READ FPDMA QUEUED
60 80 f0 80 21 00 40 00 2d+20:57:16.422 READ FPDMA QUEUED
60 80 e8 80 1f 00 40 00 2d+20:57:16.421 READ FPDMA QUEUED
60 80 e0 80 1d 00 40 00 2d+20:57:16.420 READ FPDMA QUEUEDThe other errors are all the same (Error: UNC at LBA =
0x00002468
=
9320), and at exactly the same LBA, once scrub gets to this LBA,
the
drives basically no longer responds, and querying it with smartctl
will
return garbage characters, or nothing at all. I've attached a dmesg
with also the io errors this time.Quoted 3 lines
So: I conclude scub is not going to fix this problem, and I should
really replace the disk.Agreed. It is now properly configured, there are UNC sectors logged
in
SMART, and UNC recovery is still not working. The drive is broken
and
will likely stay that way.Quoted 9 lines
@Zygo: following your advice, and using btrfs replace -r with the
failing drive online, I take it it reads only sectors from the
failing
disk if at least 2 other disks are failing at that spot (given
it's
raid6), correct?That's the general idea.
Quoted 5 lines
If so I would be comfortable giving that a shot. I do expect that while doing a replace and reading the same LBA from
the
disk, it will just crash again and ruin my replace.Quoted 9 lines
There's still another redundant disk in the array, so there's no
need
to
put too much effort into recovering one failing drive. The disk
seems
really broken, so take it offline and do a replace in degraded mode.Quoted 9 lines
Thanks for the clear help and explanations, I have 2 final questions
(famous last words :-) )
1) In your earlier reply you mentioned known bugs, including the "Spurious read errors in btrfs raid5 degraded mode". Would replacing
with "-r" while the faulty drive is still online not prevent this from
happening?The bug only seems to affect kernel read code, which tries to avoid unnecessary reads so it has a lot of special cases (not degraded, degraded, P corrupted, Q corrupted...). Scrub uses different code which
is much simpler, always reads the entire stripe at once, and doesn't
seem to be affected by the read bug. Replace is implemented as a special
case of scrub internally, so it has the same read behavior as scrub.In testing I've always hit the spurious read failures with reads and
never with scrub or replace.Quoted 1 line
Assuming the replace speed is similar to the scrub speed,
Replace speed will be the same as the scrub speed
_forscrub on onedrive_.Running scrub on all disks at once will dramatically reduce performance
compared to running scrub on a single disk (or even each disk one at
a time). If you have been running scrub with a mountpoint argument instead of individual devices, then it has been running scrubs on all
disks in parallel (i.e. competing with each other), and taking far longer
than it could have.Quoted 6 lines
I'm looking at 4 days to replace the drive, would prefer if I could
keep using the filesystem while that happens.. otherwise wiping it
and
restoring from backup might actually be the fastest option.I would avoid using it as much as possible during the replace. I have
tested running raid5 in degraded mode with a fully active read/write
workload, and there were a handful of lost data blocks (17, 84K) on a
20TB restore. I don't know if the extra Q disk for raid6 helps, raid6
is not something I'm testing so far.Quoted 9 lines
2) If I go the offline way, how would I actually do that? I do not
see
a command in the btrfs manual to flag a disk as faulty, or any other
command to move into "degraded" mode. I could unplug it while power
off
ofcourse, is that the best / only way?That, or 'echo 1 > /sys/block/sdd/device/delete'. Mount with -o degraded
to allow the filesystem to be read-write while degraded.Quoted 9 lines
btrfs does not have a "forcibly evict a drive" feature of its own, but
it
will remove a drive if the kernel tells it the drive is gone. It's one
of
the conspicuously missing features from the multi-device admin interface.Started the replace I courageously (or foolishly, we'll see) decided to
do it on the mounted filesystem.I issued this command (with
/dev/sdethe faulty but online disk, and/dev/sdbthe new one):sudo btrfs replace start -r
/dev/sde/dev/sdb/homeI immediately found some funny behaviour, that may be bugs, or my misunderstanding of the
tools/btrfs.
1) the io load shows that inspite of '-r' the drive replaced (sde) is seeing the same amount of reads as the other drives in the array. That's not what I expected reading the btrfs replace man-page. This is
the output of 'pcp dstat --disk -D total,sdb,sde,sdf,sdh,sdd'--dsk/sdb-----dsk/sdd-----dsk/sde-----dsk/sdf-----dsk/sdh---- dsk/total-
read writ: read writ: read writ: read writ: read writ: read writ
0 52M: 41M 0 : 55M 0 : 43M 0 : 52M 0 : 191M 52M
0 66M: 48M 0 : 63M 0 : 47M 0 : 67M 0 : 225M 66M
0 66M: 49M 64k: 66M 68k: 49M 64k: 64M 128k: 228M 67M
0 67M: 51M 0 : 67M 0 : 51M 0 : 68M 0 : 237M 67M
0 75M: 57M 0 : 75M 0 : 57M 0 : 76M 0 : 265M 75M
0 71M: 53M 0 : 71M 0 : 50M 0 : 71M 0 : 244M 71M
0 45M: 30M 6459k: 39M 6188k: 31M 6555k: 39M 6827k: 139M 71M
0 35M: 27M 12k: 35M 12k: 27M 12k: 36M 12k: 125M 35M
0 54M: 41M 0 : 53M 0 : 40M 0 : 53M 0 : 187M 54MQuoted 8 lines
0 66M: 50M 0 : 66M 0 : 49M 0 : 66M 0 : 232M 66M
0 64M: 47M 0 : 63M 0 : 47M 0 : 64M 0 : 221M 64M
0 68M: 51M 0 : 69M 0 : 52M 0 : 69M 0 : 240M 68M
0 73M: 56M 0 : 74M 0 : 56M 0 : 74M 0 : 261M 73MThat might be due to raid6. Scrub is not well adapted for the parity RAID levels. Another bug to add to the list...
Quoted 7 lines
2) the scrub status for the faulty drive (I cancelled the scrub) show that the scrub is actually running. This scared me for a bit, I though
I forgot to cancel the scrub before running replace, but I looked at my
command history and I actually did cancel it. Also the "Duration' in the status report is not increasing. Seems a bug?
Quoted 32 lines
Yeah, scrub and replace share so much of their implementation that the scrub tools can get confused by traces of replace state. A scrub cancel
will even cancel a replace.Quoted 27 lines
This is the output of
'sudo btrfs scrub status/dev/sde', sde being the faulty diskUUID: fce03447-ad88-4891-b91f-390665fcd5e7 Scrub started: Tue Mar 30 13:42:36 2021 Status: running
Duration: 0:06:42
Time left: 130:24:00
ETA: Tue Apr 6 21:48:55 2021 Total to scrub: 12.28TiB
Bytes scrubbed: 10.76GiB (0.09%)
Rate: 27.40MiB/s
Error summary: csum=24
Corrected: 23
Uncorrectable: 1
Unverified: 0Things might crash when I reach the LBA with the problem on the faulty
disk, we'll see.In addition, I noticed that the replace command runs at about twice the
speed as the scrub, but the systemload is much higher. I guess scrub is
a lower ionice priority than replace.
Well, the faulty disk has been succesfully replace with a new one, and almost all is well. I do not think I lost any data (check in progress against backup), some observations to share, and a question to ask.
First the question: I do have a single uncorrectable error show up after a scrub on the new device. It says "unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd" in dmesg. I did the following to further debug:
1) Trying to find whether it is in a broken file with: "btrfs inspect- internal logical-resolve 10102571008 /home" returns nothing (no output)
2) The block before is in a file, checked with the same command; the hundred or so blocks after returns nothing either, then it's a new file.
3) Trying to dump the block tree with "btrfs inspect-internal dump-tree -b 10102571008 /dev/sdd" gives
btrfs-progs v5.10
checksum verify failed on 10102571008 found 000000FB wanted 0000004C checksum verify failed on 10102571008 found 00000004 wanted 0000001D checksum verify failed on 10102571008 found 000000C6 wanted FFFFFFC9 checksum verify failed on 10102571008 found 000000C6 wanted FFFFFFC9 bad tree block 10102571008, bytenr mismatch, want=10102571008, have=17344089911063923244
ERROR: failed to read tree block 10102571008
Question: Is there a way to just remove the block? Or otherwise fix it so that it does not show up in scrubs? I think it's probably just the result of a partial write just before a crash.
Now for the observations during the replacement of the drive:
1) Doing a replace on a online non-degraded array, while using it, does not give any of the spurious IO errors Zygo mentioned, at least not in my n=1 case.
2) Doing a replace on an online non-degrated array, while using it, is still not a great experience in my case. While I did not get any spurious IO, the kernel did crash several times, when reading a file with a problem. It unfortunately carshed hard enough to not leave any of the OOPS info on disk, so I can't be very helpful there. It was somewhat reproducible, starting firefox from the homedirs (the btrfs fs) consistently crashed the system (3 times), after wiping the firefox cache and state dirs, the crash no long occured. I would recommend not using the filesystem while replacing a drive (and I should have followed Zygo's advice myself).
3) The projected time for replace seems to be an over estimate (guessing it calculates on total space available, not on space used).
4) The projected time for a scrub on a single disk is also overestimated (by a lot, almost a factor of 4), perhaps it is calculated based on all 4 disks or something?
Quoted 3,407 lines
Quoted 3,407 lines
Quoted 3,405 lines
Quoted 3,405 lines
Quoted 3,403 lines
Quoted 3,402 lines
thanks!
Quoted 291 lines · Zygo Blaxell
Quoted 9 lines · Bas Hulsken
Dear list,
due to a disk intermittently failing in my 4 disk array, I'm
getting
"transid verify failed" errors on my btrfs filesystem (see
attached
dmesg | grep -i btrfs dump in btrfs_dmesg.txt).Scary! But in this case, it looks like they were
automatically
recovered
already.Quoted 4 lines
When I run a scrub,
the bad disk (/dev/sdd) becomes unresponsive, so I'm hesitant
to tryQuoted 8 lines
that again (happened 3 times now, and was the root cause of
the
transid
verify failed errors possibly, at least they did not show up
earlier
than the failed scrub).That is quite common when disks fail. The extra IO load results
in a
firmware crash, either due to failure of the electronics disrupting the
embedded CPU so it can't run any program correctly, or an error
condition
in the rest of the disk that the firmware doesn't handle properly.
Any unflushed writes in the write cache at this time are lost.
Lost
metadata writes will result in parent transid verify failures
later on.Low end desktop drives have very large SCTERC timeouts but no
SCTERC
controls, so they have very long IO error retry loops (2 minutes).
That can look like an intermittent failure in the logs, but in
fact
it's
an ordinary remappable UNC sector. The kernel has a default
timeout
of 30 seconds, so the kernel forces a drive reset before the
drive can
report the bad block. The drive can often be used normally by
setting
the kernel timeout with 'echo 180 >/sys/block/sd.../device/timeout'.Whether you _want_ to use a disk with firmware that waits two
full
minutes before reporting an IO error is a separate question,
but
this
is a feature of several popular cheap drive models, and you _can_
use
these disks if needed.Quoted 10 lines
A new disk is on it's way to use btrfs replace, but I'm not sure whehter that will be a wise choice for a filesystem
with errors. There was never a crash/power failure, so the
filesystem
was unmounted at every reboot, but as said on 3 occasions (after a
scrub), that unmount was with on of the four drives unresponsive.Note that
1. in the logs each distinct bytenr occurs exactly once
(more
precisely, "not more than N - 1 times for a RAID profile
with
N copies"), and2. it is immediately followed by 4x "read error corrected"
e.g.
Quoted 20 lines
[38079.437411] BTRFS error (device sdg): parent transidverify
failed
on 12884760723456 wanted 360620 found
359101[38079.457879] BTRFS info (device sdg): read errorcorrected:
ino 0
off 12884760723456 (dev/dev/sddsector
12559526656)[38079.459418] BTRFS info (device sdg): read errorcorrected:
ino 0
off 12884760727552 (dev/dev/sddsector
12559526664)[38079.460390] BTRFS info (device sdg): read errorcorrected:
ino 0
off 12884760731648 (dev/dev/sddsector
12559526672)Quoted 5 lines
[38079.460585] BTRFS info (device sdg): read errorcorrected:
ino 0
off 12884760735744 (dev/dev/sddsector
12559526680)Metadata pages are 16K by default, and filesystem pages are 4K
on
amd64/x86/arm/aarch64, so these 4 "read error corrected" lines
are
btrfs
replacing one broken metadata page on sdd using data from other
mirrors.If you are using raid1* metadata, this is part of normal recovery
from
a disk failure.The failing disk will not be keeping up with metadata updates
(because
it's failing, you can't assume it will be doing anything correctly).
Writes will be lost on sdd that are not lost on the other mirror
drives.
btrfs will continue without error as long as at least one mirror
drive
is OK. btrfs will notice during later reads that some metadata
pages
are not up to date on the failing disk, and correct the failing
disk
using redundant copies of the metadata from the other mirrors.Similar correction is applied to data when the csums do not match.
nodatacow files (which do not have csums) will be corrupted.
That is
part of the cost of nodatacow--no recovery from data corruption
errors.Quoted 9 lines
Funnily enough, after a reboot every time the filesystem gets
mounted
without issues (the unresponsive drive is back online), and
btrfs
check --readonly claims the filesystem has no errors (see attached
btrfs_sdd_check.txt).There's no error on the disk by the time you run btrfs check or
reboot
and
mount again. "read error corrected" means correct data was written
back
to the failing disk. With UNC sector remapping in disk firmware,
btrfs
could even repair the UNC sector so the disk is no longer failing.
The only hint would be "Reallocated sector count" in SMART stats-
-and
only if you are lucky enough to have that count reported accurately by
your drive firmware.Possibly there are still error errors on disk, but btrfs check
didn't
happen to read that particular block from that particular mirror.
btrfs check won't verify the contents of every mirror are correct--that
is what scrub is for. If btrfs check passes, it means at least
one
usable copy has been found for every metadata page in the filesystem.
Scrub can handle all remaining errors.Quoted 9 lines
There are 20 unique "transid very failed" errors, I've dumped
all the blocks, but that file is too large to attach here,
see
https://steadydecline.net/public/btrfs_dump_failed_transid_blocks.txt
),
the super is in the attached btrfs_sdd_dump_super.txtQuoted 12 lines
Not sure what to do next, so seeking your advice! The important
data
on the drive is backed up, and I'll be running a verify to
see
if
there are any corruptions overnight. Would still like to try
to
save
the filesystem if possible though.Replace the disk as usual. There's no indication of unrecoverable
metadata failure. btrfs found some damage on the failing disk,
but
repaired it automatically.Run 'btrfs replace' to reconstruct the content of the failing
drive
on the new one. Run a scrub after that's done to make sure all
errors
were corrected (or identify damaged raid6 data blocks if they
were
not),
then resume your normal scrubbing schedule.If possible, try keeping the old disk online during the replace
operation,
in case there are errors on other disks too. Use 'btrfs replace
-r'
to prefer to read from other disks, and only use the failing
disk
as
a last resort. Don't try too hard--a failing disk is a failing
disk,
so if it's really broken, then let it go.There is raid6 in this filesystem, so this list of bugs applies:
https://lore.kernel.org/linux-btrfs/[email protected]/btrfs replace may hang a few times during recovery. Reboot to
work
around
that bug (btrfs-replace-wrong-state-after-exit and btrfs- replace-
lockup).Quoted 579 lines
You may lose a few data blocks here and there (a "few" meaning
about
"one in ten thousand corrupted blocks"). You can identify which
data
blocks using scrub, or simply try to read all files and note
any
IO errors encountered. Delete the broken files and replace their
content from backups to work around that bug (read-repair- failure,
parity-update-failure).Quoted 563 lines
best regards,
Bassuperblock: bytenr=65536, device=/dev/sdd
---------------------------------------------------------
csum_type 1 (xxhash64)
csum_size 8
csum 0x3de224bec6584bb7 [match] bytenr 65536
flags 0x1
( WRITTEN )
magic _BHRfS_M [match]
fsid fce03447-ad88-4891-b91f-390665fcd5e7
metadata_uuid fce03447-ad88-4891-b91f-390665fcd5e7
label homedirs
generation 368950
root 12883568295936 sys_array_size 193 chunk_root_generation 367570
root_level 1
chunk_root 23134208 chunk_root_level 1
log_root 0
log_root_transid 0
log_root_level 0
total_bytes 32006252888064 bytes_used 13410457739264 sectorsize 4096
nodesize 16384
leafsize (deprecated) 16384
stripesize 4096
root_dir 6
num_devices 4
compat_flags 0x0
compat_ro_flags 0x0
incompat_flags 0x9e1
(MIXED_BACKREF|BIG_METADATA|EXTENDED_IREF|
RAID56 |SKINNY_METADATA| RAID1C34 ) cache_generation 368950 uuid_tree_generation 368950
dev_item.uuid 691827bd-b866-42ad-b0c0-eb81a4bfcfeb
dev_item.fsid fce03447-ad88-4891-b91f-390665fcd5e7
[match]
dev_item.type 0
dev_item.total_bytes 8001563222016 dev_item.bytes_used 6774245556224 dev_item.io_align 4096
dev_item.io_width 4096 dev_item.sector_size 4096
dev_item.devid 3
dev_item.dev_group 0
dev_item.seek_speed 0
dev_item.bandwidth 0
dev_item.generation 0
sys_chunk_array[2048]:
item 0 key (FIRST_CHUNK_TREECHUNK_ITEM22020096) length 8388608 owner 2stripe_len65536 type
SYSTEM|RAID1C4
io_align 65536io_width65536sector_size4096
num_stripes 4sub_stripes1 stripe 0 devid 1 offset 22020096dev_uuid9c8b19be-c344-4be0-9726-34bf674d0349
stripe 1 devid 2 offset 1048576dev_uuid0542bb91-9989-4155-aec2-3baf0d848675
stripe 2 devid 3 offset 1048576dev_uuid691827bd-b866-42ad-b0c0-eb81a4bfcfeb
stripe 3 devid 4 offset 1048576dev_uuid51f99a35-7fca-4f38-8469-5fa12a1623a7
backup_roots[4]:
backup 0:
backup_tree_root: 12883564068864 g en:
368949 level: 1
backup_chunk_root: 23134208 g en:
367570 level: 1
backup_extent_root: 12883562348544 g en:
368949 level: 2
backup_fs_root: 12883557957632 g en:
368949 level: 2
backup_dev_root: 12883678691328 g en:
367580 level: 1
backup_csum_root: 12883558776832 g en:
368949 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457206784 backup_num_devices: 4backup 1:
backup_tree_root: 12883568295936 g en:
368950 level: 1
backup_chunk_root: 23134208 g en:
367570 level: 1
backup_extent_root: 12883566575616 g en:
368950 level: 2
backup_fs_root: 12883559759872 g en:
368950 level: 2
backup_dev_root: 12883678691328 g en:
367580 level: 1
backup_csum_root: 12883560382464 g en:
368950 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457739264 backup_num_devices: 4backup 2:
backup_tree_root: 12883564462080 g en:
368947 level: 1
backup_chunk_root: 23134208 g en:
367570 level: 1
backup_extent_root: 12883563347968 g en:
368947 level: 2
backup_fs_root: 12883555663872 g en:
368947 level: 2
backup_dev_root: 12883678691328 g en:
367580 level: 1
backup_csum_root: 12883562217472 g en:
368947 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457006080 backup_num_devices: 4backup 3:
backup_tree_root: 12883566510080 g en:
368948 level: 1
backup_chunk_root: 23134208 g en:
367570 level: 1
backup_extent_root: 12883559759872 g en:
368948 level: 2
backup_fs_root: 12883553746944 g en:
368948 level: 2
backup_dev_root: 12883678691328 g en:
367580 level: 1
backup_csum_root: 12883555434496 g en:
368948 level: 3
backup_total_bytes: 32006252888064 backup_bytes_used: 13410457116672 backup_num_devices: 4[ 0.864538] Btrfs loaded, crc32c=crc32c-generic, zoned=yes
[ 13.368410] BTRFS: device label homedirs devid 2 transid
367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid
367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid
367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid
367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is
enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents
[ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs:
wr
0, rd
1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs:
wr
0, rd
0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs:
wr
74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: notfinished
on
devid
3 with status: -125[ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: notfinished
on
devid
3 with status: -125[23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdgerrs:
wr
0, rd
1, flush 0, corrupt 0, gen 0[23639.169393] BTRFS info (device sdg): bdev /dev/sdeerrs:
wr
0, rd
0, flush 0, corrupt 23, gen 0[23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failedroot 5
ino
13004600 off 1388544 csum0x89644c3d02062469expected csum0x006926a7eef0358fmirror 1[70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failedroot 5
ino
13004600 off 1384448 csum0x3281ab5806ee6c8fexpected csum0xf81ccd9e0fd3faa6mirror 1[70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read errorcorrected:
ino 0
off 12886944968704 (dev/dev/sddsector 12563792760)[1/7] checking root items
[2/7] checking extents
[3/7] checking free space cache
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data) [6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS)
Opening filesystem to check...
Checking filesystem on/dev/sdd
UUID: fce03447-ad88-4891-b91f-390665fcd5e7 found 13364248408064 bytes used, no error found total csum bytes: 26044304216
total tree bytes: 29511155712
total fs tree bytes: 1468596224
total extent tree bytes: 232357888
btree space waste bytes: 1737736698
file data blocks allocated: 13545978748928 referenced 13336378105856[ 10.340190] sd 4:0:2:0: [sdd] 15628053168 512-byte logical
blocks: (8.00 TB/7.28 TiB)
[ 10.340191] sd 4:0:2:0: [sdd] 4096-byte physical blocks [ 10.340198] sd 4:0:2:0: [sdd] Write Protect is off [ 10.340200] sd 4:0:2:0: [sdd] Mode Sense: 00 3a 00 00 [ 10.340211] sd 4:0:2:0: [sdd] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[ 10.373337] sd 4:0:2:0: [sdd] Attached SCSI disk [ 13.368410] BTRFS: device label homedirs devid 2 transid 367206/dev/sdescanned by systemd-udevd (644)
[ 13.379691] BTRFS: device label homedirs devid 3 transid 367206/dev/sddscanned by systemd-udevd (646)
[ 13.382411] BTRFS: device label homedirs devid 4 transid 367206/dev/sdcscanned by systemd-udevd (648)
[ 13.398436] BTRFS: device label homedirs devid 1 transid 367206/dev/sdgscanned by systemd-udevd (652)
[ 13.750256] BTRFS info (device sdg): disk space caching is enabled
[ 13.750260] BTRFS info (device sdg): has skinny extents [ 14.710747] BTRFS info (device sdg): bdev/dev/sdgerrs:
wr 0,
rd 1, flush 0, corrupt 0, gen 0
[ 14.712675] BTRFS info (device sdg): bdev/dev/sdeerrs:
wr 0,
rd 0, flush 0, corrupt 23, gen 0
[ 14.714555] BTRFS info (device sdg): bdev/dev/sdderrs:
wr
74390652, rd 1756348, flush 189, corrupt 37082, gen 21 [ 25.444099] BTRFS info (device sdg): checking UUID tree[ 5585.543078] BTRFS info (device sdg): scrub: started on devid 3 [ 5661.646404] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [ 5661.681282] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [ 6001.726239] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [ 6365.446732] BTRFS error (device sdg): parent transid verify failed on 12887115939840 wanted 359811 found 359779 [ 6365.458935] BTRFS info (device sdg): read error corrected: ino 0 off 12887115939840 (dev /dev/sdd sector 12564126688) [ 6365.460173] BTRFS info (device sdg): read error corrected: ino 0 off 12887115943936 (dev /dev/sdd sector 12564126696) [ 6365.461201] BTRFS info (device sdg): read error corrected: ino 0 off 12887115948032 (dev /dev/sdd sector 12564126704) [ 6365.461472] BTRFS info (device sdg): read error corrected: ino 0 off 12887115952128 (dev /dev/sdd sector 12564126712) [ 6369.607540] BTRFS error (device sdg): parent transid verify failed on 12002143010816 wanted 357838 found 357635 [ 6369.627007] BTRFS info (device sdg): read error corrected: ino 0 off 12002143010816 (dev /dev/sdd sector 11747925056) [ 6369.627946] BTRFS info (device sdg): read error corrected: ino 0 off 12002143014912 (dev /dev/sdd sector 11747925064) [ 6369.629425] BTRFS info (device sdg): read error corrected: ino 0 off 12002143019008 (dev /dev/sdd sector 11747925072) [ 6369.630019] BTRFS info (device sdg): read error corrected: ino 0 off 12002143023104 (dev /dev/sdd sector 11747925080) [ 6369.906563] BTRFS error (device sdg): parent transid verify failed on 12887116201984 wanted 359811 found 359780 [ 6369.907822] BTRFS info (device sdg): read error corrected: ino 0 off 12887116201984 (dev /dev/sdd sector 12564127200) [ 6369.908297] BTRFS info (device sdg): read error corrected: ino 0 off 12887116206080 (dev /dev/sdd sector 12564127208) [ 6370.082144] BTRFS error (device sdg): parent transid verify failed on 12887116251136 wanted 359811 found 359780 [ 6370.085084] BTRFS error (device sdg): parent transid verify failed on 12887116365824 wanted 359811 found 359780 [ 6378.874360] BTRFS error (device sdg): parent transid verify failed on 12002146205696 wanted 357838 found 357635 [ 6378.896860] repair_io_failure: 10 callbacks suppressed [ 6378.896865] BTRFS info (device sdg): read error corrected: ino 0 off 12002146205696 (dev /dev/sdd sector 11747931296) [ 6378.899224] BTRFS info (device sdg): read error corrected: ino 0 off 12002146209792 (dev /dev/sdd sector 11747931304) [ 6378.900376] BTRFS info (device sdg): read error corrected: ino 0 off 12002146213888 (dev /dev/sdd sector 11747931312) [ 6378.901048] BTRFS info (device sdg): read error corrected: ino 0 off 12002146217984 (dev /dev/sdd sector 11747931320) [ 6378.901332] BTRFS error (device sdg): parent transid verify failed on 12002146467840 wanted 357838 found 357635 [ 6378.901890] BTRFS info (device sdg): read error corrected: ino 0 off 12002146467840 (dev /dev/sdd sector 11747931808) [ 6378.902122] BTRFS info (device sdg): read error corrected: ino 0 off 12002146471936 (dev /dev/sdd sector 11747931816) [ 6378.902318] BTRFS info (device sdg): read error corrected: ino 0 off 12002146476032 (dev /dev/sdd sector 11747931824) [ 6378.902525] BTRFS info (device sdg): read error corrected: ino 0 off 12002146480128 (dev /dev/sdd sector 11747931832) [ 6378.915275] BTRFS error (device sdg): parent transid verify failed on 12002147631104 wanted 357838 found 357635 [ 6378.923147] BTRFS info (device sdg): read error corrected: ino 0 off 12002147631104 (dev /dev/sdd sector 11747934080) [ 6378.923804] BTRFS info (device sdg): read error corrected: ino 0 off 12002147635200 (dev /dev/sdd sector 11747934088) [ 6378.992162] BTRFS error (device sdg): parent transid verify failed on 12002146959360 wanted 357838 found 357635 [ 6378.997017] BTRFS error (device sdg): parent transid verify failed on 12002147155968 wanted 357838 found 357635 [ 6379.133024] BTRFS error (device sdg): parent transid verify failed on 12002146385920 wanted 357838 found 357635 [ 6379.137035] BTRFS error (device sdg): parent transid verify failed on 12002146402304 wanted 357838 found 357635 [ 6380.140516] BTRFS error (device sdg): parent transid verify failed on 12002146123776 wanted 357838 found 357635 [ 6380.680832] BTRFS error (device sdg): parent transid verify failed on 12002240020480 wanted 357838 found 357635 [13673.751319] BTRFS info (device sdg): scrub: started on devid 3 [16826.036404] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [23638.218998] BTRFS info (device sdg): disk space caching is enabled [23638.220428] BTRFS info (device sdg): has skinny extents [23639.167931] BTRFS info (device sdg): bdev /dev/sdg errs: wr 0, rd 1, flush 0, corrupt 0, gen 0 [23639.169393] BTRFS info (device sdg): bdev /dev/sde errs: wr 0, rd 0, flush 0, corrupt 23, gen 0 [23639.170871] BTRFS info (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37083, gen 21 [38079.437411] BTRFS error (device sdg): parent transid verify failed on 12884760723456 wanted 360620 found 359101 [38079.457874] repair_io_failure: 26 callbacks suppressed [38079.457879] BTRFS info (device sdg): read error corrected: ino 0 off 12884760723456 (dev /dev/sdd sector 12559526656) [38079.459418] BTRFS info (device sdg): read error corrected: ino 0 off 12884760727552 (dev /dev/sdd sector 12559526664) [38079.460390] BTRFS info (device sdg): read error corrected: ino 0 off 12884760731648 (dev /dev/sdd sector 12559526672) [38079.460585] BTRFS info (device sdg): read error corrected: ino 0 off 12884760735744 (dev /dev/sdd sector 12559526680) [38221.384604] BTRFS error (device sdg): parent transid verify failed on 12887984144384 wanted 357793 found 357612 [38221.402557] BTRFS info (device sdg): read error corrected: ino 0 off 12887984144384 (dev /dev/sdd sector 12565822400) [38221.404162] BTRFS info (device sdg): read error corrected: ino 0 off 12887984148480 (dev /dev/sdd sector 12565822408) [38221.404757] BTRFS info (device sdg): read error corrected: ino 0 off 12887984152576 (dev /dev/sdd sector 12565822416) [38221.405024] BTRFS info (device sdg): read error corrected: ino 0 off 12887984156672 (dev /dev/sdd sector 12565822424) [65806.904757] BTRFS error (device sdg): parent transid verify failed on 12884812627968 wanted 360627 found 359022 [65806.918919] BTRFS info (device sdg): read error corrected: ino 0 off 12884812627968 (dev /dev/sdd sector 12559628032) [65806.920934] BTRFS info (device sdg): read error corrected: ino 0 off 12884812632064 (dev /dev/sdd sector 12559628040) [65806.922112] BTRFS info (device sdg): read error corrected: ino 0 off 12884812636160 (dev /dev/sdd sector 12559628048) [65806.922728] BTRFS info (device sdg): read error corrected: ino 0 off 12884812640256 (dev /dev/sdd sector 12559628056) [70219.837853] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1388544 csum 0x89644c3d02062469 expected csum 0x006926a7eef0358f mirror 1 [70219.841358] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37084, gen 21 [70219.843858] BTRFS info (device sdg): read error corrected: ino 13004600 off 1388544 (dev /dev/sdd sector 8499704456) [70219.858611] BTRFS warning (device sdg): csum failed root 5 ino 13004600 off 1384448 csum 0x3281ab5806ee6c8f expected csum 0xf81ccd9e0fd3faa6 mirror 1 [70219.862320] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37085, gen 21 [70219.864440] BTRFS info (device sdg): read error corrected: ino 13004600 off 1384448 (dev /dev/sdd sector 8499704448) [85509.387364] BTRFS error (device sdg): parent transid verify failed on 12887136485376 wanted 359811 found 359594 [85509.410871] BTRFS info (device sdg): read error corrected: ino 0 off 12887136485376 (dev /dev/sdd sector 12564166816) [85509.413277] BTRFS info (device sdg): read error corrected: ino 0 off 12887136489472 (dev /dev/sdd sector 12564166824) [85509.415928] BTRFS info (device sdg): read error corrected: ino 0 off 12887136493568 (dev /dev/sdd sector 12564166832) [85509.418011] BTRFS info (device sdg): read error corrected: ino 0 off 12887136497664 (dev /dev/sdd sector 12564166840) [86025.084757] BTRFS error (device sdg): parent transid verify failed on 12887142547456 wanted 359802 found 359785 [86025.103698] BTRFS info (device sdg): read error corrected: ino 0 off 12887142547456 (dev /dev/sdd sector 12564178656) [86025.105889] BTRFS info (device sdg): read error corrected: ino 0 off 12887142551552 (dev /dev/sdd sector 12564178664) [86025.108065] BTRFS info (device sdg): read error corrected: ino 0 off 12887142555648 (dev /dev/sdd sector 12564178672) [86025.110341] BTRFS info (device sdg): read error corrected: ino 0 off 12887142559744 (dev /dev/sdd sector 12564178680) [89093.407662] BTRFS error (device sdg): parent transid verify failed on 12886944956416 wanted 357751 found 357579 [89093.423399] BTRFS info (device sdg): read error corrected: ino 0 off 12886944956416 (dev /dev/sdd sector 12563792736) [89093.424792] BTRFS info (device sdg): read error corrected: ino 0 off 12886944960512 (dev /dev/sdd sector 12563792744) [89093.425905] BTRFS info (device sdg): read error corrected: ino 0 off 12886944964608 (dev /dev/sdd sector 12563792752) [89093.426976] BTRFS info (device sdg): read error corrected: ino 0 off 12886944968704 (dev /dev/sdd sector 12563792760) [175365.130738] BTRFS error (device sdg): parent transid verify failed on 12886956064768 wanted 357752 found 357580 [175365.197967] BTRFS info (device sdg): read error corrected: ino 0 off 12886956064768 (dev /dev/sdd sector 12563814432) [175365.200168] BTRFS info (device sdg): read error corrected: ino 0 off 12886956068864 (dev /dev/sdd sector 12563814440) [175365.202271] BTRFS info (device sdg): read error corrected: ino 0 off 12886956072960 (dev /dev/sdd sector 12563814448) [175365.204354] BTRFS info (device sdg): read error corrected: ino 0 off 12886956077056 (dev /dev/sdd sector 12563814456) [176458.125146] BTRFS error (device sdg): parent transid verify failed on 12887898587136 wanted 357785 found 357607 [176458.141330] BTRFS info (device sdg): read error corrected: ino 0 off 12887898587136 (dev /dev/sdd sector 12565655296) [176458.143944] BTRFS info (device sdg): read error corrected: ino 0 off 12887898591232 (dev /dev/sdd sector 12565655304) [176458.145887] BTRFS info (device sdg): read error corrected: ino 0 off 12887898595328 (dev /dev/sdd sector 12565655312) [176458.147776] BTRFS info (device sdg): read error corrected: ino 0 off 12887898599424 (dev /dev/sdd sector 12565655320) [229945.146691] BTRFS error (device sdg): parent transid verify failed on 12885496791040 wanted 357700 found 357535 [229945.157340] BTRFS info (device sdg): read error corrected: ino 0 off 12885496791040 (dev /dev/sdd sector 12560964288) [229945.159127] BTRFS info (device sdg): read error corrected: ino 0 off 12885496795136 (dev /dev/sdd sector 12560964296) [229945.161000] BTRFS info (device sdg): read error corrected: ino 0 off 12885496799232 (dev /dev/sdd sector 12560964304) [229945.162835] BTRFS info (device sdg): read error corrected: ino 0 off 12885496803328 (dev /dev/sdd sector 12560964312) [229945.164764] BTRFS error (device sdg): parent transid verify failed on 12885496807424 wanted 357700 found 357535 [229945.166985] BTRFS info (device sdg): read error corrected: ino 0 off 12885496807424 (dev /dev/sdd sector 12560964320) [229945.168927] BTRFS info (device sdg): read error corrected: ino 0 off 12885496811520 (dev /dev/sdd sector 12560964328) [229945.170807] BTRFS info (device sdg): read error corrected: ino 0 off 12885496815616 (dev /dev/sdd sector 12560964336) [229945.172695] BTRFS info (device sdg): read error corrected: ino 0 off 12885496819712 (dev /dev/sdd sector 12560964344) [230214.519209] BTRFS info (device sdg): scrub: started on devid 3 [230291.988628] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756348, flush 189, corrupt 37086, gen 21 [230291.997391] BTRFS error (device sdg): unable to fixup (regular) error at logical 10102571008 on dev /dev/sdd [233375.205625] BTRFS error (device sdg): parent transid verify failed on 12887574511616 wanted 357774 found 357599 [233375.290159] BTRFS info (device sdg): read error corrected: ino 0 off 12887574511616 (dev /dev/sdd sector 12565022336) [233375.292087] BTRFS info (device sdg): read error corrected: ino 0 off 12887574515712 (dev /dev/sdd sector 12565022344) [233375.293908] BTRFS info (device sdg): read error corrected: ino 0 off 12887574519808 (dev /dev/sdd sector 12565022352) [233375.295647] BTRFS info (device sdg): read error corrected: ino 0 off 12887574523904 (dev /dev/sdd sector 12565022360) [233832.001374] BTRFS error (device sdg): parent transid verify failed on 12887123804160 wanted 359811 found 359704 [233832.084098] BTRFS info (device sdg): read error corrected: ino 0 off 12887123804160 (dev /dev/sdd sector 12564142048) [233832.086073] BTRFS info (device sdg): read error corrected: ino 0 off 12887123808256 (dev /dev/sdd sector 12564142056) [233832.087796] BTRFS info (device sdg): read error corrected: ino 0 off 12887123812352 (dev /dev/sdd sector 12564142064) [233832.089507] BTRFS info (device sdg): read error corrected: ino 0 off 12887123816448 (dev /dev/sdd sector 12564142072) [239527.304785] BTRFS error (device sdg): parent transid verify failed on 12886930227200 wanted 357751 found 357579 [239527.331156] BTRFS info (device sdg): read error corrected: ino 0 off 12886930227200 (dev /dev/sdd sector 12563763968) [239527.334237] BTRFS info (device sdg): read error corrected: ino 0 off 12886930231296 (dev /dev/sdd sector 12563763976) [239527.335905] BTRFS info (device sdg): read error corrected: ino 0 off 12886930235392 (dev /dev/sdd sector 12563763984) [239527.337596] BTRFS info (device sdg): read error corrected: ino 0 off 12886930239488 (dev /dev/sdd sector 12563763992) [241139.967354] BTRFS error (device sdg): parent transid verify failed on 12001961410560 wanted 357836 found 357632 [241140.011489] BTRFS info (device sdg): read error corrected: ino 0 off 12001961410560 (dev /dev/sdd sector 11747570368) [241140.013559] BTRFS info (device sdg): read error corrected: ino 0 off 12001961414656 (dev /dev/sdd sector 11747570376) [241140.016843] BTRFS info (device sdg): read error corrected: ino 0 off 12001961418752 (dev /dev/sdd sector 11747570384) [241140.127471] BTRFS info (device sdg): read error corrected: ino 0 off 12001961422848 (dev /dev/sdd sector 11747570392) [244514.702945] BTRFS error (device sdg): parent transid verify failed on 12887435296768 wanted 357767 found 357596 [244514.770956] BTRFS info (device sdg): read error corrected: ino 0 off 12887435296768 (dev /dev/sdd sector 12564750432) [244514.772944] BTRFS info (device sdg): read error corrected: ino 0 off 12887435300864 (dev /dev/sdd sector 12564750440) [244514.776232] BTRFS info (device sdg): read error corrected: ino 0 off 12887435304960 (dev /dev/sdd sector 12564750448) [244514.777671] BTRFS info (device sdg): read error corrected: ino 0 off 12887435309056 (dev /dev/sdd sector 12564750456) [244522.038809] BTRFS error (device sdg): parent transid verify failed on 12887435313152 wanted 357767 found 357594 [244522.120518] BTRFS info (device sdg): read error corrected: ino 0 off 12887435313152 (dev /dev/sdd sector 12564750464) [244522.122291] BTRFS info (device sdg): read error corrected: ino 0 off 12887435317248 (dev /dev/sdd sector 12564750472) [244522.123582] BTRFS info (device sdg): read error corrected: ino 0 off 12887435321344 (dev /dev/sdd sector 12564750480) [244522.124836] BTRFS info (device sdg): read error corrected: ino 0 off 12887435325440 (dev /dev/sdd sector 12564750488) [246861.175551] BTRFS error (device sdg): parent transid verify failed on 12887462084608 wanted 357768 found 357596 [246861.234507] BTRFS info (device sdg): read error corrected: ino 0 off 12887462084608 (dev /dev/sdd sector 12564802752) [246861.236349] BTRFS info (device sdg): read error corrected: ino 0 off 12887462088704 (dev /dev/sdd sector 12564802760) [246861.238165] BTRFS info (device sdg): read error corrected: ino 0 off 12887462092800 (dev /dev/sdd sector 12564802768) [246861.239863] BTRFS info (device sdg): read error corrected: ino 0 off 12887462096896 (dev /dev/sdd sector 12564802776) [248185.323608] sas: Enter sas_scsi_recover_host busy: 23 failed: 23 [248185.324525] sas: trying to find task 0x0000000025b267cc [248185.324530] sas: sas_scsi_find_task: aborting task 0x0000000025b267cc [248185.325468] sas: sas_scsi_find_task: task 0x0000000025b267cc is aborted [248185.326401] sas: sas_eh_handle_sas_errors: task 0x0000000025b267cc is aborted [248185.327366] sas: trying to find task 0x0000000040e3e246 [248185.327369] sas: sas_scsi_find_task: aborting task 0x0000000040e3e246 [248185.328341] sas: sas_scsi_find_task: task 0x0000000040e3e246 is aborted [248185.329311] sas: sas_eh_handle_sas_errors: task 0x0000000040e3e246 is aborted [248185.330292] sas: trying to find task 0x0000000011fd3d76 [248185.330294] sas: sas_scsi_find_task: aborting task 0x0000000011fd3d76 [248185.331274] sas: sas_scsi_find_task: task 0x0000000011fd3d76 is aborted [248185.332256] sas: sas_eh_handle_sas_errors: task 0x0000000011fd3d76 is aborted [248185.333270] sas: trying to find task 0x000000001aeb6768 [248185.333272] sas: sas_scsi_find_task: aborting task 0x000000001aeb6768 [248185.334294] sas: sas_scsi_find_task: task 0x000000001aeb6768 is aborted [248185.335323] sas: sas_eh_handle_sas_errors: task 0x000000001aeb6768 is aborted [248185.336363] sas: trying to find task 0x00000000dcb4fb6a [248185.336366] sas: sas_scsi_find_task: aborting task 0x00000000dcb4fb6a [248185.337411] sas: sas_scsi_find_task: task 0x00000000dcb4fb6a is aborted [248185.338462] sas: sas_eh_handle_sas_errors: task 0x00000000dcb4fb6a is aborted [248185.339536] sas: trying to find task 0x00000000713475b5 [248185.339538] sas: sas_scsi_find_task: aborting task 0x00000000713475b5 [248185.340623] sas: sas_scsi_find_task: task 0x00000000713475b5 is aborted [248185.341727] sas: sas_eh_handle_sas_errors: task 0x00000000713475b5 is aborted [248185.342853] sas: trying to find task 0x0000000022bf1484 [248185.342856] sas: sas_scsi_find_task: aborting task 0x0000000022bf1484 [248185.343986] sas: sas_scsi_find_task: task 0x0000000022bf1484 is aborted [248185.345107] sas: sas_eh_handle_sas_errors: task 0x0000000022bf1484 is aborted [248185.346232] sas: trying to find task 0x00000000c1be6881 [248185.346234] sas: sas_scsi_find_task: aborting task 0x00000000c1be6881 [248185.347366] sas: sas_scsi_find_task: task 0x00000000c1be6881 is aborted [248185.348509] sas: sas_eh_handle_sas_errors: task 0x00000000c1be6881 is aborted [248185.349675] sas: trying to find task 0x0000000094632cad [248185.349678] sas: sas_scsi_find_task: aborting task 0x0000000094632cad [248185.350855] sas: sas_scsi_find_task: task 0x0000000094632cad is aborted [248185.352028] sas: sas_eh_handle_sas_errors: task 0x0000000094632cad is aborted [248185.353217] sas: trying to find task 0x00000000369ca205 [248185.353219] sas: sas_scsi_find_task: aborting task 0x00000000369ca205 [248185.354416] sas: sas_scsi_find_task: task 0x00000000369ca205 is aborted [248185.355621] sas: sas_eh_handle_sas_errors: task 0x00000000369ca205 is aborted [248185.356849] sas: ata7: end_device-4:2: cmd error handler [248185.356910] sas: ata5: end_device-4:0: dev error handler [248185.356930] sas: ata6: end_device-4:1: dev error handler [248185.356937] sas: ata7: end_device-4:2: dev error handler [248185.356943] ata7.00: exception Emask 0x1 SAct 0xfe581fff SErr 0x0 action 0x6 frozen [248185.356949] sas: ata8: end_device-4:3: dev error handler [248185.356984] sas: ata9: end_device-4:4: dev error handler [248185.357000] sas: ata10: end_device-4:5: dev error handler [248185.358239] ata7.00: failed command: READ FPDMA QUEUED [248185.359517] ata7.00: cmd60/80:00:80:25:00/00:00:89:00:00/40
tag 0 ncq dma 65536 in
res
43/40:00:68:24:00/00:00:89:00:00/40
Emask0x9(media error)[248185.362113] ata7.00: status: { DRDY SENSE ERR } [248185.363412] ata7.00: error: { UNC } [248185.364702] ata7.00: failed command: READ FPDMA QUEUED [248185.366008] ata7.00: cmd60/80:00:80:27:00/00:00:89:00:00/40
tag 1 ncq dma 65536 in
res
43/04:08:80:27:00/00:00:89:00:00/40
Emask0x1(device error)[248185.368705] ata7.00: status: { DRDY SENSE ERR } [248185.370059] ata7.00: error: { ABRT } [248185.371406] ata7.00: failed command: READ FPDMA QUEUED [248185.372764] ata7.00: cmd60/80:00:00:17:00/00:00:89:00:00/40
tag 2 ncq dma 65536 in
res
43/04:10:00:17:00/00:00:89:00:00/40
Emask0x1(device error)[248185.375565] ata7.00: status: { DRDY SENSE ERR } [248185.376985] ata7.00: error: { ABRT } [248185.378416] ata7.00: failed command: READ FPDMA QUEUED [248185.379832] ata7.00: cmd60/80:00:00:19:00/00:00:89:00:00/40
tag 3 ncq dma 65536 in
res
43/04:18:00:19:00/00:00:89:00:00/40
Emask0x1(device error)[248185.382668] ata7.00: status: { DRDY SENSE ERR } [248185.384082] ata7.00: error: { ABRT } [248185.385477] ata7.00: failed command: READ FPDMA QUEUED [248185.386881] ata7.00: cmd60/80:00:00:1b:00/00:00:89:00:00/40
tag 4 ncq dma 65536 in
res
43/04:20:00:1b:00/00:00:89:00:00/40
Emask0x1(device error)[248185.389716] ata7.00: status: { DRDY SENSE ERR } [248185.391135] ata7.00: error: { ABRT } [248185.392535] ata7.00: failed command: READ FPDMA QUEUED [248185.393934] ata7.00: cmd60/80:00:00:1d:00/00:00:89:00:00/40
tag 5 ncq dma 65536 in
res
43/04:28:00:1d:00/00:00:89:00:00/40
Emask0x1(device error)[248185.396777] ata7.00: status: { DRDY SENSE ERR } [248185.398192] ata7.00: error: { ABRT } [248185.399596] ata7.00: failed command: READ FPDMA QUEUED [248185.400996] ata7.00: cmd60/80:00:00:1f:00/00:00:89:00:00/40
tag 6 ncq dma 65536 in
res
43/04:38:00:21:00/00:00:89:00:00/40
Emask0x1(device error)[248185.403850] ata7.00: status: { DRDY SENSE ERR } [248185.405203] ata7.00: error: { ABRT } [248185.406527] ata7.00: failed command: READ FPDMA QUEUED [248185.407800] ata7.00: cmd60/80:00:00:21:00/00:00:89:00:00/40
tag 7 ncq dma 65536 in
res
43/04:38:00:21:00/00:00:89:00:00/40
Emask0x1(device error)[248185.410355] ata7.00: status: { DRDY SENSE ERR } [248185.411578] ata7.00: error: { ABRT } [248185.412777] ata7.00: failed command: READ FPDMA QUEUED [248185.413927] ata7.00: cmd60/80:00:00:23:00/00:00:89:00:00/40
tag 8 ncq dma 65536 in
res
43/04:40:00:23:00/00:00:89:00:00/40
Emask0x1(device error)[248185.416245] ata7.00: status: { DRDY SENSE ERR } [248185.417361] ata7.00: error: { ABRT } [248185.418456] ata7.00: failed command: READ FPDMA QUEUED [248185.419549] ata7.00: cmd60/80:00:00:25:00/00:00:89:00:00/40
tag 9 ncq dma 65536 in
res
43/04:48:00:25:00/00:00:89:00:00/40
Emask0x1(device error)[248185.421744] ata7.00: status: { DRDY SENSE ERR } [248185.422792] ata7.00: error: { ABRT } [248185.423822] ata7.00: failed command: READ FPDMA QUEUED [248185.424808] ata7.00: cmd60/80:00:00:27:00/00:00:89:00:00/40
tag 10 ncq dma 65536 in
res
43/04:50:00:27:00/00:00:89:00:00/40
Emask0x1(device error)[248185.426818] ata7.00: status: { DRDY SENSE ERR } [248185.427812] ata7.00: error: { ABRT } [248185.428803] ata7.00: failed command: READ FPDMA QUEUED [248185.429755] ata7.00: cmd60/80:00:80:29:00/00:00:89:00:00/40
tag 11 ncq dma 65536 in
res
43/04:58:80:29:00/00:00:89:00:00/40
Emask0x1(device error)[248185.431691] ata7.00: status: { DRDY SENSE ERR } [248185.432624] ata7.00: error: { ABRT } [248185.433535] ata7.00: failed command: READ FPDMA QUEUED [248185.434443] ata7.00: cmd60/80:00:00:29:00/00:00:89:00:00/40
tag 12 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x1(device error)[248185.436245] ata7.00: status: { DRDY SENSE ERR } [248185.437136] ata7.00: error: { ABRT } [248185.438016] ata7.00: failed command: READ FPDMA QUEUED [248185.438870] ata7.00: cmd60/00:00:00:24:00/01:00:89:00:00/40
tag 19 ncq dma 131072 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.440604] ata7.00: status: { DRDY SENSE ERR } [248185.441465] ata7.00: error: { ABRT } [248185.442319] ata7.00: failed command: READ FPDMA QUEUED [248185.443150] ata7.00: cmd60/00:00:00:26:00/01:00:89:00:00/40
tag 20 ncq dma 131072 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.444852] ata7.00: status: { DRDY SENSE ERR } [248185.445689] ata7.00: error: { ABRT } [248185.446501] ata7.00: failed command: READ FPDMA QUEUED [248185.447298] ata7.00: cmd60/00:00:00:28:00/01:00:89:00:00/40
tag 22 ncq dma 131072 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.448944] ata7.00: status: { DRDY SENSE ERR } [248185.449739] ata7.00: error: { ABRT } [248185.450510] ata7.00: failed command: READ FPDMA QUEUED [248185.451277] ata7.00: cmd60/80:00:80:17:00/00:00:89:00:00/40
tag 25 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.452852] ata7.00: status: { DRDY SENSE ERR } [248185.453617] ata7.00: error: { ABRT } [248185.454362] ata7.00: failed command: READ FPDMA QUEUED [248185.455106] ata7.00: cmd60/80:00:80:19:00/00:00:89:00:00/40
tag 26 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.456633] ata7.00: status: { DRDY SENSE ERR } [248185.457391] ata7.00: error: { ABRT } [248185.458160] ata7.00: failed command: READ FPDMA QUEUED [248185.458913] ata7.00: cmd60/80:00:80:1b:00/00:00:89:00:00/40
tag 27 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.460403] ata7.00: status: { DRDY SENSE ERR } [248185.461144] ata7.00: error: { ABRT } [248185.461877] ata7.00: failed command: READ FPDMA QUEUED [248185.462624] ata7.00: cmd60/80:00:80:1d:00/00:00:89:00:00/40
tag 28 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.464121] ata7.00: status: { DRDY SENSE ERR } [248185.464859] ata7.00: error: { ABRT } [248185.465581] ata7.00: failed command: READ FPDMA QUEUED [248185.466291] ata7.00: cmd60/80:00:80:1f:00/00:00:89:00:00/40
tag 29 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.467748] ata7.00: status: { DRDY SENSE ERR } [248185.468453] ata7.00: error: { ABRT } [248185.469167] ata7.00: failed command: READ FPDMA QUEUED [248185.469875] ata7.00: cmd60/80:00:80:21:00/00:00:89:00:00/40
tag 30 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.471309] ata7.00: status: { DRDY SENSE ERR } [248185.472025] ata7.00: error: { ABRT } [248185.472740] ata7.00: failed command: READ FPDMA QUEUED [248185.473431] ata7.00: cmd60/80:00:80:23:00/00:00:89:00:00/40
tag 31 ncq dma 65536 in
res
43/04:60:00:29:00/00:00:89:00:00/40
Emask0x5(timeout)[248185.474881] ata7.00: status: { DRDY SENSE ERR } [248185.475598] ata7.00: error: { ABRT } [248185.476291] ata7: hard resetting link [248185.642262] sas: sas_form_port: phy0 belongs to port2 already(1)! [248187.732565] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248192.916472] ata7.00: qc timeout (cmd 0xec) [248192.917921] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248192.919286] ata7.00: revalidation failed (errno=-5) [248192.920627] ata7: hard resetting link [248193.086049] sas: sas_form_port: phy0 belongs to port2 already(1)! [248195.156355] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248205.717134] ata7.00: qc timeout (cmd 0xa1) [248205.717188] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248205.717234] ata7.00: revalidation failed (errno=-5) [248205.717274] ata7: hard resetting link [248205.881563] sas: sas_form_port: phy0 belongs to port2 already(1)! [248207.956064] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248238.483453] ata7.00: qc timeout (cmd 0xa1) [248238.484852] ata7.00: failed to IDENTIFY (I/O error, err_mask=0x5) [248238.486205] ata7.00: revalidation failed (errno=-5) [248238.487539] ata7.00: disabled [248238.653105] sas: sas_form_port: phy0 belongs to port2 already(1)! [248240.723356] drivers/scsi/mvsas/mv_sas.c 1415:mvs_I_T_nexus_reset for device[0]:rc= 0 [248240.875378] sd 4:0:2:0: [sdd] tag#341 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=64s [248240.876786] sd 4:0:2:0: [sdd] tag#341 Sense Key : Not Ready [current] [248240.878170] sd 4:0:2:0: [sdd] tag#341 Add. Sense: Logical unit not ready, hard reset required [248240.879564] sd 4:0:2:0: [sdd] tag#341 CDB: Read(16) 88 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.880971] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.882483] ata7: EH complete [248240.883936] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 23 tries: 1 [248240.885612] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.886930] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 89 00 25 80 00 00 00 80 00 00 [248240.888059] blk_update_request: I/O error, dev sdd, sector 2298488192 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.889244] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.890416] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 00 46 11 00 00 00 00 80 00 00 [248240.891589] blk_update_request: I/O error, dev sdd, sector 4591872 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248240.892790] sd 4:0:2:0: [sdd] tag#370 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.894016] sd 4:0:2:0: [sdd] tag#370 CDB: Write(16) 8a 00 00 00 00 00 00 7f a9 80 00 00 00 80 00 00 [248240.895262] blk_update_request: I/O error, dev sdd, sector 8366464 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248240.896719] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248240.898440] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 86 70 00 00 01 90 00 00 [248240.898442] blk_update_request: I/O error, dev sdd, sector 445810288 op 0x1:(WRITE) flags 0x0 phys_seg 50 prio class 0 [248240.898468] sd 4:0:2:0: [sdd] tag#373 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898471] sd 4:0:2:0: [sdd] tag#373 CDB: Read(16) 88 00 00 00 00 00 89 00 23 80 00 00 00 80 00 00 [248240.898473] blk_update_request: I/O error, dev sdd, sector 2298487680 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898485] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898487] sd 4:0:2:0: [sdd] tag#374 CDB: Read(16) 88 00 00 00 00 00 89 00 21 80 00 00 00 80 00 00 [248240.898489] blk_update_request: I/O error, dev sdd, sector 2298487168 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898495] sd 4:0:2:0: [sdd] tag#375 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898498] sd 4:0:2:0: [sdd] tag#375 CDB: Read(16) 88 00 00 00 00 00 89 00 1f 80 00 00 00 80 00 00 [248240.898499] blk_update_request: I/O error, dev sdd, sector 2298486656 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898506] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898516] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 89 00 1d 80 00 00 00 80 00 00 [248240.898518] blk_update_request: I/O error, dev sdd, sector 2298486144 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248240.898523] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=64s [248240.898679] blk_update_request: I/O error, dev sdd, sector 446460800 op 0x1:(WRITE) flags 0x0 phys_seg 112 prio class 0 [248240.899999] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390652, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.918953] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756349, flush 189, corrupt 37086, gen 21 [248240.919392] sd 4:0:2:0: [sdd] tag#379 CDB: Read(16) 88 00 00 00 00 00 89 00 1b 80 00 00 00 80 00 00 [248241.032740] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756350, flush 189, corrupt 37086, gen 21 [248241.036581] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756351, flush 189, corrupt 37086, gen 21 [248241.157945] BTRFS warning (device sdg): i/o error atlogical
2347222237184 on dev/dev/sdd, physical 1176826544128, root 5,
inode 1119818, offset 1004863488, length 4096, links 1 (path:
<REMOVED>)[248241.157950] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756352, flush 189, corrupt 37086, gen 21 [248241.157957] BTRFS warning (device sdg): i/o error atlogical
2347223810048 on dev/dev/sdd, physical 1176827330560, root 5,
inode 1119818, offset 1006436352, length 4096, links 1 (path:
<REMOVED>)[248241.157957] BTRFS warning (device sdg): i/o error atlogical
2347224858624 on dev/dev/sdd, physical 1176827854848, root 5,
inode 1119818, offset 1007484928, length 4096, links 1 (path:
<REMOVED>)[248241.157971] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756353, flush 189, corrupt 37086, gen 21 [248241.158062] BTRFS warning (device sdg): i/o error atlogical
2347223285760 on dev/dev/sdd, physical 1176827068416, root 5,
inode 1119818, offset 1005912064, length 4096, links 1 (path:
<REMOVED>)[248241.158071] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756354, flush 189, corrupt 37086, gen 21 [248241.158171] BTRFS warning (device sdg): i/o error atlogical
2347222761472 on dev/dev/sdd, physical 1176826806272, root 5,
inode 1119818, offset 1005387776, length 4096, links 1 (path:
<REMOVED>)[248241.158178] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756355, flush 189, corrupt 37086, gen 21 [248241.163801] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390653, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.179914] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74390654, rd 1756356, flush 189, corrupt 37086, gen 21 [248241.198529] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222237184 on dev /dev/sdd [248241.198939] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347222761472 on dev /dev/sdd [248241.199055] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223285760 on dev /dev/sdd [248241.199339] BTRFS warning (device sdg): i/o error atlogical
2347223351296 on dev/dev/sdd, physical 1176827133952, root 5,
inode 1119818, offset 1005977600, length 4096, links 1 (path:
<REMOVED>)[248241.199945] BTRFS warning (device sdg): i/o error atlogical
2347222302720 on dev/dev/sdd, physical 1176826609664, root 5,
inode 1119818, offset 1004929024, length 4096, links 1 (path:
<REMOVED>)[248241.200048] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224858624 on dev /dev/sdd [248241.200236] BTRFS warning (device sdg): i/o error atlogical
2347224924160 on dev/dev/sdd, physical 1176827920384, root 5,
inode 1119818, offset 1007550464, length 4096, links 1 (path:
<REMOVED>)[248241.201048] BTRFS warning (device sdg): i/o error atlogical
2347222827008 on dev/dev/sdd, physical 1176826871808, root 5,
inode 1119818, offset 1005453312, length 4096, links 1 (path:
<REMOVED>)[248241.201159] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224334336 on dev /dev/sdd [248241.201188] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223810048 on dev /dev/sdd [248241.216166] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223875584 on dev /dev/sdd [248241.220764] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224924160 on dev /dev/sdd [248241.223012] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347224399872 on dev /dev/sdd [248241.224564] BTRFS error (device sdg): unable to fixup (regular) error at logical 2347223351296 on dev /dev/sdd [248241.552090] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.552801] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.553390] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248241.587414] BTRFS error (device sdg): error writing primary super block to device 3 [248241.597855] BTRFS info (device sdg): scrub: not finished on devid 3 with status: -125 [248246.510344] scsi_io_completion_action: 2646 callbacks suppressed [248246.510354] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.513974] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.515035] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 2d 41 08 00 00 00 18 00 00 [248246.517310] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 00 00 2f 42 80 00 00 00 68 00 00 [248246.519554] print_req_error: 2647 callbacks suppressed [248246.519556] blk_update_request: I/O error, dev sdd, sector 2965768 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248246.521786] blk_update_request: I/O error, dev sdd, sector 3097216 op 0x0:(READ) flags 0x0 phys_seg 13 prio class 0 [248246.548440] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248246.550622] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 00 2f 42 e8 00 00 00 18 00 00 [248246.552762] blk_update_request: I/O error, dev sdd, sector 3097320 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248247.312672] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.313341] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314351] sd 4:0:2:0: [sdd] tag#364 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.314358] sd 4:0:2:0: [sdd] tag#364 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 80 00 00 00 80 00 00 [248247.314361] blk_update_request: I/O error, dev sdd, sector 379584128 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.314833] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 16 9f fd 80 00 00 00 80 00 00 [248247.316918] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 00 16 9f fe 00 00 00 00 80 00 00 [248247.318927] blk_update_request: I/O error, dev sdd, sector 379583872 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.320923] blk_update_request: I/O error, dev sdd, sector 379584000 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248247.339165] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248247.341190] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 16 9f ff 00 00 00 00 80 00 00 [248247.343224] blk_update_request: I/O error, dev sdd, sector 379584256 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248251.985758] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248251.989913] sd 4:0:2:0: [sdd] tag#321 CDB: Read(16) 88 00 00 00 00 00 00 2f 43 00 00 00 00 80 00 00 [248251.992006] blk_update_request: I/O error, dev sdd, sector 3097344 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248253.492058] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492083] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492125] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.492132] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 00 00 36 49 80 00 00 00 80 00 00 [248253.492134] blk_update_request: I/O error, dev sdd, sector 3557760 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248253.495611] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248253.495617] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 00 00 e0 4a f0 00 00 00 08 00 00 [248253.495619] blk_update_request: I/O error, dev sdd, sector 14699248 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.496193] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4a 98 00 00 00 08 00 00 [248253.498278] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 00 34 4f 80 00 00 00 80 00 00 [248253.500302] blk_update_request: I/O error, dev sdd, sector 2902680 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248253.516167] blk_update_request: I/O error, dev sdd, sector 3428224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.191723] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.195373] sd 4:0:2:0: [sdd] tag#343 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 00 00 00 00 80 00 00 [248254.197609] blk_update_request: I/O error, dev sdd, sector 455574016 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.199941] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.202240] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 1b 27 82 80 00 00 00 80 00 00 [248254.204515] blk_update_request: I/O error, dev sdd, sector 455574144 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.206872] sd 4:0:2:0: [sdd] tag#353 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.209220] sd 4:0:2:0: [sdd] tag#353 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 00 00 00 00 80 00 00 [248254.211586] blk_update_request: I/O error, dev sdd, sector 455574272 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.213992] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216369] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 1b 27 83 80 00 00 00 80 00 00 [248254.216370] blk_update_request: I/O error, dev sdd, sector 455574400 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248254.216405] sd 4:0:2:0: [sdd] tag#359 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248254.216407] sd 4:0:2:0: [sdd] tag#359 CDB: Write(16) 8a 00 00 00 00 00 1b 27 84 00 00 00 00 80 00 00 [248254.216408] blk_update_request: I/O error, dev sdd, sector 455574528 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.400125] scsi_io_completion_action: 9 callbacks suppressed [248265.400136] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.400977] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401965] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.401972] sd 4:0:2:0: [sdd] tag#383 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 00 00 00 00 80 00 00 [248265.401974] print_req_error: 9 callbacks suppressed [248265.401976] blk_update_request: I/O error, dev sdd, sector 620212480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402093] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402097] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b1 80 00 00 00 80 00 00 [248265.402099] blk_update_request: I/O error, dev sdd, sector 620212608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402252] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.402256] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 00 00 00 00 80 00 00 [248265.402258] blk_update_request: I/O error, dev sdd, sector 620212736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.402274] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 00 00 00 00 80 00 00 [248265.402276] blk_update_request: I/O error, dev sdd, sector 620212224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.404418] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b0 80 00 00 00 80 00 00 [248265.404421] blk_update_request: I/O error, dev sdd, sector 620212352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.407580] sd 4:0:2:0: [sdd] tag#328 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.438963] sd 4:0:2:0: [sdd] tag#328 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b2 80 00 00 00 80 00 00 [248265.441211] blk_update_request: I/O error, dev sdd, sector 620212864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.443497] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.445761] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 00 00 00 00 80 00 00 [248265.447921] blk_update_request: I/O error, dev sdd, sector 620212992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.450038] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.452151] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b3 80 00 00 00 80 00 00 [248265.454132] blk_update_request: I/O error, dev sdd, sector 620213120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.456137] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.458043] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 00 00 00 00 80 00 00 [248265.459922] blk_update_request: I/O error, dev sdd, sector 620213248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248265.461752] sd 4:0:2:0: [sdd] tag#352 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248265.463587] sd 4:0:2:0: [sdd] tag#352 CDB: Write(16) 8a 00 00 00 00 00 24 f7 b4 80 00 00 00 80 00 00 [248265.465335] blk_update_request: I/O error, dev sdd, sector 620213376 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.623282] scsi_io_completion_action: 5 callbacks suppressed [248271.623293] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.623299] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625635] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625657] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 00 00 00 00 80 00 00 [248271.625660] print_req_error: 5 callbacks suppressed [248271.625662] blk_update_request: I/O error, dev sdd, sector 445825024 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625735] sd 4:0:2:0: [sdd] tag#380 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 80 00 00 00 80 00 00 [248271.625782] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.625786] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c0 80 00 00 00 80 00 00 [248271.625788] blk_update_request: I/O error, dev sdd, sector 445825152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.625998] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.626002] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 1a 92 c1 00 00 00 00 80 00 00 [248271.626003] blk_update_request: I/O error, dev sdd, sector 445825280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.628180] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1a 92 bf 00 00 00 00 80 00 00 [248271.630551] blk_update_request: I/O error, dev sdd, sector 445824896 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.660964] blk_update_request: I/O error, dev sdd, sector 445824768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.769033] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.771463] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 00 00 00 00 80 00 00 [248271.772126] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.773871] blk_update_request: I/O error, dev sdd, sector 379599104 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775065] sd 4:0:2:0: [sdd] tag#355 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775072] sd 4:0:2:0: [sdd] tag#355 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 00 00 00 00 80 00 00 [248271.775074] blk_update_request: I/O error, dev sdd, sector 396374784 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775090] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775093] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 17 a0 33 80 00 00 00 80 00 00 [248271.775095] blk_update_request: I/O error, dev sdd, sector 396374912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775103] sd 4:0:2:0: [sdd] tag#361 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248271.775106] sd 4:0:2:0: [sdd] tag#361 CDB: Write(16) 8a 00 00 00 00 00 17 a0 34 00 00 00 00 80 00 00 [248271.775108] blk_update_request: I/O error, dev sdd, sector 396375040 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.775132] blk_update_request: I/O error, dev sdd, sector 426428928 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248271.776264] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 16 a0 39 80 00 00 00 80 00 00 [248271.829322] btrfs_dev_stat_print_on_error: 1552 callbacks suppressed [248271.829327] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392181, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.831689] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392182, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.832863] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392183, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.834033] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392184, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.835164] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392185, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836004] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392186, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.836265] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392187, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.837319] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392188, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.838362] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392189, rd 1756382, flush 190, corrupt 37086, gen 21 [248271.839402] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392190, rd 1756382, flush 190, corrupt 37086, gen 21 [248272.029872] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031357] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.031919] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248272.062041] BTRFS error (device sdg): error writing primary super block to device 3 [248277.001230] scsi_io_completion_action: 173 callbacks suppressed [248277.001240] sd 4:0:2:0: [sdd] tag#356 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.002605] sd 4:0:2:0: [sdd] tag#358 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.003050] sd 4:0:2:0: [sdd] tag#356 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 80 00 00 00 80 00 00 [248277.004885] sd 4:0:2:0: [sdd] tag#358 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 00 00 00 00 80 00 00 [248277.006725] print_req_error: 174 callbacks suppressed [248277.006727] blk_update_request: I/O error, dev sdd, sector 18708864 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.008574] blk_update_request: I/O error, dev sdd, sector 18708992 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.013396] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.017475] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 01 1d 79 00 00 00 00 80 00 00 [248277.019229] blk_update_request: I/O error, dev sdd, sector 18708736 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.022505] sd 4:0:2:0: [sdd] tag#365 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.024304] sd 4:0:2:0: [sdd] tag#365 CDB: Write(16) 8a 00 00 00 00 00 01 1d 7a 80 00 00 00 80 00 00 [248277.026057] blk_update_request: I/O error, dev sdd, sector 18709120 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.906882] sd 4:0:2:0: [sdd] tag#325 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.906893] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.908685] sd 4:0:2:0: [sdd] tag#325 CDB: Write(16) 8a 00 00 00 00 00 00 2c 4b 80 00 00 00 80 00 00 [248277.910454] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 00 34 53 80 00 00 00 80 00 00 [248277.910457] blk_update_request: I/O error, dev sdd, sector 3429248 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.912178] blk_update_request: I/O error, dev sdd, sector 2902912 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248277.917256] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248277.918924] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 36 4a 00 00 00 00 80 00 00 [248277.920584] blk_update_request: I/O error, dev sdd, sector 3557888 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248280.875522] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.876631] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248280.878928] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a5 80 00 00 00 80 00 00 [248280.880663] sd 4:0:2:0: [sdd] tag#334 CDB: Write(16) 8a 00 00 00 00 00 00 c2 a6 00 00 00 00 10 00 00 [248280.880666] blk_update_request: I/O error, dev sdd, sector 12756480 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248280.882378] blk_update_request: I/O error, dev sdd, sector 12756352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248285.091160] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248285.093669] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 00 00 2f 6e 00 00 00 00 80 00 00 [248285.094997] blk_update_request: I/O error, dev sdd, sector 3108352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.154539] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156053] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.156475] sd 4:0:2:0: [sdd] tag#340 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d4 80 00 00 00 80 00 00 [248286.157669] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157675] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 80 00 00 00 80 00 00 [248286.157677] blk_update_request: I/O error, dev sdd, sector 455923584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157794] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157798] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 00 00 00 00 80 00 00 [248286.157800] blk_update_request: I/O error, dev sdd, sector 455923712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.157908] sd 4:0:2:0: [sdd] tag#372 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.157912] sd 4:0:2:0: [sdd] tag#372 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d8 80 00 00 00 80 00 00 [248286.157913] blk_update_request: I/O error, dev sdd, sector 455923840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158098] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158101] sd 4:0:2:0: [sdd] tag#382 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 00 00 00 00 80 00 00 [248286.158103] blk_update_request: I/O error, dev sdd, sector 455923968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158255] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158259] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d9 80 00 00 00 80 00 00 [248286.158260] blk_update_request: I/O error, dev sdd, sector 455924096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.158390] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d7 00 00 00 00 80 00 00 [248286.158414] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.158418] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1b 2c da 00 00 00 00 80 00 00 [248286.158419] blk_update_request: I/O error, dev sdd, sector 455924224 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160329] blk_update_request: I/O error, dev sdd, sector 455922816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.160367] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248286.162312] blk_update_request: I/O error, dev sdd, sector 455923456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172179] blk_update_request: I/O error, dev sdd, sector 455924352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248286.172696] sd 4:0:2:0: [sdd] tag#347 CDB: Write(16) 8a 00 00 00 00 00 1b 2c d5 00 00 00 00 80 00 00 [248290.623307] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.624705] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248290.626020] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248291.988874] scsi_io_completion_action: 4 callbacks suppressed [248291.988884] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248291.993237] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f 81 00 00 00 00 80 00 00 [248291.995414] print_req_error: 4 callbacks suppressed [248291.995417] blk_update_request: I/O error, dev sdd, sector 3113216 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248296.181222] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.182569] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248296.183866] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248297.423222] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.424233] sd 4:0:2:0: [sdd] tag#354 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426301] sd 4:0:2:0: [sdd] tag#362 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426309] sd 4:0:2:0: [sdd] tag#362 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 00 00 00 00 80 00 00 [248297.426311] blk_update_request: I/O error, dev sdd, sector 446755072 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426421] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426424] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f1 80 00 00 00 80 00 00 [248297.426426] blk_update_request: I/O error, dev sdd, sector 446755200 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426559] sd 4:0:2:0: [sdd] tag#369 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426562] sd 4:0:2:0: [sdd] tag#369 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 00 00 00 00 80 00 00 [248297.426564] blk_update_request: I/O error, dev sdd, sector 446755328 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426667] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426670] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f2 80 00 00 00 80 00 00 [248297.426672] blk_update_request: I/O error, dev sdd, sector 446755456 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426834] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426837] sd 4:0:2:0: [sdd] tag#324 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 00 00 00 00 80 00 00 [248297.426839] blk_update_request: I/O error, dev sdd, sector 446755584 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.426942] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.426945] sd 4:0:2:0: [sdd] tag#327 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f3 80 00 00 00 80 00 00 [248297.426947] blk_update_request: I/O error, dev sdd, sector 446755712 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427050] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427054] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 00 00 00 00 80 00 00 [248297.427055] blk_update_request: I/O error, dev sdd, sector 446755840 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427179] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248297.427182] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f4 80 00 00 00 80 00 00 [248297.427184] blk_update_request: I/O error, dev sdd, sector 446755968 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427383] blk_update_request: I/O error, dev sdd, sector 446756096 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248297.427419] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 00 00 00 00 80 00 00 [248297.429588] sd 4:0:2:0: [sdd] tag#354 CDB: Write(16) 8a 00 00 00 00 00 1a a0 f0 80 00 00 00 80 00 00 [248297.431651] blk_update_request: I/O error, dev sdd, sector 446754816 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248299.357237] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.358591] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248299.359863] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248301.784416] btrfs_dev_stat_print_on_error: 85 callbacks suppressed [248301.784422] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392275, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.787139] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392276, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.793382] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392277, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.842622] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392278, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.857224] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756382, flush 191, corrupt 37086, gen 21 [248301.902699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756383, flush 191, corrupt 37086, gen 21 [248301.923990] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392279, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.924022] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756384, flush 191, corrupt 37086, gen 21 [248301.980030] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756385, flush 191, corrupt 37086, gen 21 [248301.981996] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392280, rd 1756386, flush 191, corrupt 37086, gen 21 [248302.482352] scsi_io_completion_action: 71 callbacks suppressed [248302.482362] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.486139] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6d a0 00 00 00 20 00 00 [248302.488014] print_req_error: 71 callbacks suppressed [248302.488017] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.549043] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.550971] sd 4:0:2:0: [sdd] tag#326 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 00 00 00 00 48 00 00 [248302.552860] blk_update_request: I/O error, dev sdd, sector 3114752 op 0x0:(READ) flags 0x0 phys_seg 9 prio class 0 [248302.554768] sd 4:0:2:0: [sdd] tag#327 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.556682] sd 4:0:2:0: [sdd] tag#327 CDB: Read(16) 88 00 00 00 00 00 00 2f 87 60 00 00 00 20 00 00 [248302.558558] blk_update_request: I/O error, dev sdd, sector 3114848 op 0x0:(READ) flags 0x0 phys_seg 4 prio class 0 [248302.580488] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.582404] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6d a0 00 00 00 08 00 00 [248302.584286] blk_update_request: I/O error, dev sdd, sector 12559609248 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.586227] sd 4:0:2:0: [sdd] tag#331 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.586284] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.588144] sd 4:0:2:0: [sdd] tag#331 CDB: Write(16) 8a 00 00 00 00 00 00 34 5a b0 00 00 00 18 00 00 [248302.590030] sd 4:0:2:0: [sdd] tag#332 CDB: Read(16) 88 00 00 00 00 02 ec 9c 6e 20 00 00 00 20 00 00 [248302.591863] blk_update_request: I/O error, dev sdd, sector 3431088 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.593698] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248302.604651] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.606535] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 2f bb 00 00 00 00 80 00 00 [248302.608370] blk_update_request: I/O error, dev sdd, sector 3128064 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248302.613761] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.614282] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.615659] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 00 00 2f 87 48 00 00 00 18 00 00 [248302.617550] sd 4:0:2:0: [sdd] tag#346 CDB: Write(16) 8a 00 00 00 00 02 ec 9c 6e 20 00 00 00 08 00 00 [248302.617552] blk_update_request: I/O error, dev sdd, sector 12559609376 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248302.619395] blk_update_request: I/O error, dev sdd, sector 3114824 op 0x1:(WRITE) flags 0x0 phys_seg 3 prio class 0 [248302.625183] sd 4:0:2:0: [sdd] tag#347 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248302.627048] sd 4:0:2:0: [sdd] tag#347 CDB: Read(16) 88 00 00 00 00 02 ec 93 24 c0 00 00 00 20 00 00 [248302.628894] blk_update_request: I/O error, dev sdd, sector 12559000768 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248303.042756] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.043453] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.044802] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248303.078613] BTRFS error (device sdg): error writing primary super block to device 3 [248305.317351] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.318565] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248305.319737] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248308.909087] scsi_io_completion_action: 401 callbacks suppressed [248308.909097] sd 4:0:2:0: [sdd] tag#360 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248308.913267] sd 4:0:2:0: [sdd] tag#360 CDB: Write(16) 8a 00 00 00 00 00 00 2a d3 80 00 00 00 80 00 00 [248308.915329] print_req_error: 402 callbacks suppressed [248308.915332] blk_update_request: I/O error, dev sdd, sector 2806656 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.890321] sd 4:0:2:0: [sdd] tag#363 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.892430] sd 4:0:2:0: [sdd] tag#363 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.894493] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248309.930751] sd 4:0:2:0: [sdd] tag#366 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248309.932849] sd 4:0:2:0: [sdd] tag#366 CDB: Write(16) 8a 00 00 00 00 00 00 2a dd 80 00 00 00 80 00 00 [248309.934920] blk_update_request: I/O error, dev sdd, sector 2809216 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.755530] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.756811] sd 4:0:2:0: [sdd] tag#377 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.759632] sd 4:0:2:0: [sdd] tag#376 CDB: Read(16) 88 00 00 00 00 00 00 2a df 00 00 00 00 18 00 00 [248312.761711] sd 4:0:2:0: [sdd] tag#377 CDB: Read(16) 88 00 00 00 00 00 00 2a df 20 00 00 00 60 00 00 [248312.761714] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x0:(READ) flags 0x0 phys_seg 12 prio class 0 [248312.763824] blk_update_request: I/O error, dev sdd, sector 2809600 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248312.786251] sd 4:0:2:0: [sdd] tag#320 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.788341] sd 4:0:2:0: [sdd] tag#320 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 80 00 00 00 80 00 00 [248312.790341] sd 4:0:2:0: [sdd] tag#323 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248312.790392] blk_update_request: I/O error, dev sdd, sector 2809728 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248312.792452] sd 4:0:2:0: [sdd] tag#323 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 18 00 00 00 08 00 00 [248312.796556] blk_update_request: I/O error, dev sdd, sector 2809624 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.486643] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.490876] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 00 2a df 20 00 00 00 08 00 00 [248316.493033] blk_update_request: I/O error, dev sdd, sector 2809632 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.543702] sd 4:0:2:0: [sdd] tag#333 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.545897] sd 4:0:2:0: [sdd] tag#333 CDB: Write(16) 8a 00 00 00 00 00 00 2a ea 00 00 00 00 80 00 00 [248316.548046] blk_update_request: I/O error, dev sdd, sector 2812416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874434] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874450] sd 4:0:2:0: [sdd] tag#338 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874570] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874577] sd 4:0:2:0: [sdd] tag#344 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 37 00 00 00 00 80 00 00 [248316.874580] blk_update_request: I/O error, dev sdd, sector 8499705600 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.874638] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.874644] sd 4:0:2:0: [sdd] tag#349 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 00 00 00 00 80 00 00 [248316.874660] blk_update_request: I/O error, dev sdd, sector 8499704576 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.876724] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 34 88 00 00 00 10 00 00 [248316.878945] sd 4:0:2:0: [sdd] tag#338 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.881121] blk_update_request: I/O error, dev sdd, sector 8499704968 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248316.881146] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.883317] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248316.885534] sd 4:0:2:0: [sdd] tag#337 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 32 78 00 00 00 08 00 00 [248316.887926] sd 4:0:2:0: [sdd] tag#357 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248316.889974] blk_update_request: I/O error, dev sdd, sector 8499704440 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0 [248316.910572] sd 4:0:2:0: [sdd] tag#357 CDB: Write(16) 8a 00 00 00 00 01 fa 9f 33 80 00 00 00 80 00 00 [248316.912873] blk_update_request: I/O error, dev sdd, sector 8499704704 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248318.558510] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.560471] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5e f8 00 00 00 30 00 00 [248318.561469] blk_update_request: I/O error, dev sdd, sector 3038968 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248318.568857] sd 4:0:2:0: [sdd] tag#376 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248318.569967] sd 4:0:2:0: [sdd] tag#376 CDB: Write(16) 8a 00 00 00 00 00 00 2e 5f 28 00 00 00 30 00 00 [248318.571091] blk_update_request: I/O error, dev sdd, sector 3039016 op 0x1:(WRITE) flags 0x0 phys_seg 6 prio class 0 [248322.218635] scsi_io_completion_action: 7 callbacks suppressed [248322.218645] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.221295] sd 4:0:2:0: [sdd] tag#342 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.222668] print_req_error: 7 callbacks suppressed [248322.222670] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0 [248322.225664] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.226557] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.227223] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 50 00 00 00 08 00 00 [248322.228752] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 00 2b 61 58 00 00 00 08 00 00 [248322.230312] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.231869] blk_update_request: I/O error, dev sdd, sector 2842968 op 0x0:(READ) flags 0x100 phys_seg 1 prio class 0 [248322.233490] btrfs_dev_stat_print_on_error: 379 callbacks suppressed [248322.233493] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756498, flush 192, corrupt 37086, gen 21 [248322.235105] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392547, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.248514] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.249822] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2b 61 50 00 00 00 10 00 00 [248322.251153] blk_update_request: I/O error, dev sdd, sector 2842960 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 [248322.252541] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392548, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.252544] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756499, flush 192, corrupt 37086, gen 21 [248322.811245] sd 4:0:2:0: [sdd] tag#349 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.813276] sd 4:0:2:0: [sdd] tag#349 CDB: Read(16) 88 00 00 00 00 00 00 e4 58 90 00 00 00 70 00 00 [248322.815284] blk_update_request: I/O error, dev sdd, sector 14964880 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248322.817812] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.819941] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 80 00 00 00 80 00 00 [248322.822087] blk_update_request: I/O error, dev sdd, sector 445777280 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.824255] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.826384] sd 4:0:2:0: [sdd] tag#378 CDB: Write(16) 8a 00 00 00 00 00 1a 92 06 00 00 00 01 80 00 00 [248322.828506] blk_update_request: I/O error, dev sdd, sector 445777408 op 0x1:(WRITE) flags 0x0 phys_seg 37 prio class 0 [248322.830692] sd 4:0:2:0: [sdd] tag#379 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.832881] sd 4:0:2:0: [sdd] tag#379 CDB: Write(16) 8a 00 00 00 00 00 1a 92 05 00 00 00 00 80 00 00 [248322.835079] blk_update_request: I/O error, dev sdd, sector 445777152 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248322.837353] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.837510] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248322.839600] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 b0 0c 83 80 00 00 02 88 00 00 [248322.839602] blk_update_request: I/O error, dev sdd, sector 2953610112 op 0x1:(WRITE) flags 0x0 phys_seg 81 prio class 0 [248322.841797] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 00 e4 58 80 00 00 00 10 00 00 [248322.848390] blk_update_request: I/O error, dev sdd, sector 14964864 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248327.416729] sd 4:0:2:0: [sdd] tag#324 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.421220] sd 4:0:2:0: [sdd] tag#324 CDB: Read(16) 88 00 00 00 00 00 00 2a fd 00 00 00 00 80 00 00 [248327.423519] blk_update_request: I/O error, dev sdd, sector 2817280 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248327.470800] sd 4:0:2:0: [sdd] tag#335 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248327.473099] sd 4:0:2:0: [sdd] tag#335 CDB: Write(16) 8a 00 00 00 00 00 00 2a fd 80 00 00 00 80 00 00 [248327.475402] blk_update_request: I/O error, dev sdd, sector 2817408 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.659428] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.661781] sd 4:0:2:0: [sdd] tag#336 CDB: Read(16) 88 00 00 00 00 00 00 30 33 00 00 00 00 80 00 00 [248328.664121] blk_update_request: I/O error, dev sdd, sector 3158784 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.795900] sd 4:0:2:0: [sdd] tag#344 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796631] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796908] sd 4:0:2:0: [sdd] tag#378 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796912] sd 4:0:2:0: [sdd] tag#378 CDB: Read(16) 88 00 00 00 00 00 00 fa 48 00 00 00 00 80 00 00 [248328.796913] blk_update_request: I/O error, dev sdd, sector 16402432 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796937] sd 4:0:2:0: [sdd] tag#380 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796940] sd 4:0:2:0: [sdd] tag#380 CDB: Read(16) 88 00 00 00 00 00 00 b4 48 00 00 00 00 80 00 00 [248328.796941] blk_update_request: I/O error, dev sdd, sector 11814912 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.796978] sd 4:0:2:0: [sdd] tag#382 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.796980] sd 4:0:2:0: [sdd] tag#382 CDB: Read(16) 88 00 00 00 00 00 19 68 48 00 00 00 00 80 00 00 [248328.796981] blk_update_request: I/O error, dev sdd, sector 426264576 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797010] sd 4:0:2:0: [sdd] tag#383 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.797012] sd 4:0:2:0: [sdd] tag#383 CDB: Read(16) 88 00 00 00 00 00 00 a8 14 80 00 00 00 80 00 00 [248328.797012] blk_update_request: I/O error, dev sdd, sector 11015296 op 0x0:(READ) flags 0x0 phys_seg 16 prio class 0 [248328.797244] sd 4:0:2:0: [sdd] tag#344 CDB: Read(16) 88 00 00 00 00 00 1a c5 c2 68 00 00 00 18 00 00 [248328.798432] sd 4:0:2:0: [sdd] tag#371 CDB: Read(16) 88 00 00 00 00 00 1b ec 62 00 00 00 00 80 00 00 [248328.799583] blk_update_request: I/O error, dev sdd, sector 449167976 op 0x0:(READ) flags 0x0 phys_seg 3 prio class 0 [248328.800763] blk_update_request: I/O error, dev sdd, sector 468476416 op 0x0:(READ) flags 0x0 phys_seg 14 prio class 0 [248328.835435] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248328.837098] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 1a c6 49 80 00 00 00 80 00 00 [248328.838700] blk_update_request: I/O error, dev sdd, sector 449202560 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248328.848446] nfsd: last server has exited, flushing export cache [248333.202511] scsi_io_completion_action: 22 callbacks suppressed [248333.202522] sd 4:0:2:0: [sdd] tag#334 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.207259] sd 4:0:2:0: [sdd] tag#334 CDB: Read(16) 88 00 00 00 00 02 ec 91 5b 40 00 00 00 20 00 00 [248333.209604] print_req_error: 22 callbacks suppressed [248333.209606] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.214330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392549, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.235374] sd 4:0:2:0: [sdd] tag#336 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.237816] sd 4:0:2:0: [sdd] tag#336 CDB: Write(16) 8a 00 00 00 00 02 ec 91 5b 40 00 00 00 08 00 00 [248333.240217] blk_update_request: I/O error, dev sdd, sector 12558883648 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.242657] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756500, flush 192, corrupt 37086, gen 21 [248333.245598] sd 4:0:2:0: [sdd] tag#337 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.248030] sd 4:0:2:0: [sdd] tag#337 CDB: Read(16) 88 00 00 00 00 02 ec 9b c1 a0 00 00 00 20 00 00 [248333.250436] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.252868] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392550, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.260039] sd 4:0:2:0: [sdd] tag#339 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.262465] sd 4:0:2:0: [sdd] tag#339 CDB: Write(16) 8a 00 00 00 00 02 ec 9b c1 a0 00 00 00 08 00 00 [248333.264859] blk_update_request: I/O error, dev sdd, sector 12559565216 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.267309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756501, flush 192, corrupt 37086, gen 21 [248333.270056] sd 4:0:2:0: [sdd] tag#340 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.272485] sd 4:0:2:0: [sdd] tag#340 CDB: Read(16) 88 00 00 00 00 02 ec 9b 65 20 00 00 00 20 00 00 [248333.274875] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.277279] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392551, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.288558] sd 4:0:2:0: [sdd] tag#342 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.290966] sd 4:0:2:0: [sdd] tag#342 CDB: Write(16) 8a 00 00 00 00 02 ec 9b 65 20 00 00 00 08 00 00 [248333.293330] blk_update_request: I/O error, dev sdd, sector 12559541536 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.295720] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756502, flush 192, corrupt 37086, gen 21 [248333.298242] sd 4:0:2:0: [sdd] tag#343 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.300727] sd 4:0:2:0: [sdd] tag#343 CDB: Read(16) 88 00 00 00 00 02 ec 93 1d e0 00 00 00 20 00 00 [248333.303196] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.305681] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392552, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.317340] sd 4:0:2:0: [sdd] tag#345 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.319891] sd 4:0:2:0: [sdd] tag#345 CDB: Write(16) 8a 00 00 00 00 02 ec 93 1d e0 00 00 00 08 00 00 [248333.322374] blk_update_request: I/O error, dev sdd, sector 12558999008 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.324918] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756503, flush 192, corrupt 37086, gen 21 [248333.327663] sd 4:0:2:0: [sdd] tag#346 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.330199] sd 4:0:2:0: [sdd] tag#346 CDB: Read(16) 88 00 00 00 00 02 ec 93 21 60 00 00 00 20 00 00 [248333.332701] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0 [248333.335239] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392553, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.344839] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248333.347378] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 02 ec 93 21 60 00 00 00 08 00 00 [248333.349920] blk_update_request: I/O error, dev sdd, sector 12558999904 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 [248333.352520] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392554, rd 1756504, flush 192, corrupt 37086, gen 21 [248333.832271] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.832933] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.833456] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248333.869878] BTRFS error (device sdg): error writing primary super block to device 3 [248343.130021] scsi_io_completion_action: 211 callbacks suppressed [248343.130032] sd 4:0:2:0: [sdd] tag#348 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248343.134636] sd 4:0:2:0: [sdd] tag#348 CDB: Write(16) 8a 00 00 00 00 00 00 2e 66 00 00 00 00 80 00 00 [248343.134638] print_req_error: 212 callbacks suppressed [248343.134640] blk_update_request: I/O error, dev sdd, sector 3040768 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248364.589574] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.590844] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248364.592072] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.236244] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.237644] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.238892] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.240126] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241384] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248366.241397] program smartctl is using a deprecated SCSI ioctl, please convert it to SG_IO [248374.163464] sd 4:0:2:0: [sdd] tag#367 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.163473] sd 4:0:2:0: [sdd] tag#368 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165017] sd 4:0:2:0: [sdd] tag#371 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165024] sd 4:0:2:0: [sdd] tag#371 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 00 00 00 00 80 00 00 [248374.165027] blk_update_request: I/O error, dev sdd, sector 18852352 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165175] sd 4:0:2:0: [sdd] tag#374 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165179] sd 4:0:2:0: [sdd] tag#374 CDB: Write(16) 8a 00 00 00 00 00 01 1f aa 80 00 00 00 80 00 00 [248374.165180] blk_update_request: I/O error, dev sdd, sector 18852480 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.165443] sd 4:0:2:0: [sdd] tag#381 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.165450] sd 4:0:2:0: [sdd] tag#381 CDB: Write(16) 8a 00 00 00 00 00 01 1f ab 00 00 00 00 80 00 00 [248374.165452] blk_update_request: I/O error, dev sdd, sector 18852608 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166596] sd 4:0:2:0: [sdd] tag#321 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166601] sd 4:0:2:0: [sdd] tag#321 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 00 00 00 00 80 00 00 [248374.166603] blk_update_request: I/O error, dev sdd, sector 17788416 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166610] sd 4:0:2:0: [sdd] tag#322 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166615] sd 4:0:2:0: [sdd] tag#322 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6d 80 00 00 00 80 00 00 [248374.166617] blk_update_request: I/O error, dev sdd, sector 17788288 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.166734] sd 4:0:2:0: [sdd] tag#326 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.166738] sd 4:0:2:0: [sdd] tag#326 CDB: Write(16) 8a 00 00 00 00 00 01 0f 6e 80 00 00 00 10 00 00 [248374.166739] blk_update_request: I/O error, dev sdd, sector 17788544 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0 [248374.167144] sd 4:0:2:0: [sdd] tag#367 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 80 00 00 00 80 00 00 [248374.167777] sd 4:0:2:0: [sdd] tag#330 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167781] sd 4:0:2:0: [sdd] tag#330 CDB: Write(16) 8a 00 00 00 00 00 01 1a ef 80 00 00 00 80 00 00 [248374.167783] blk_update_request: I/O error, dev sdd, sector 18542464 op 0x1:(WRITE) flags 0x0 phys_seg 8 prio class 0 [248374.167794] sd 4:0:2:0: [sdd] tag#332 FAILED Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK cmd_age=0s [248374.167799] sd 4:0:2:0: [sdd] tag#332 CDB: Write(16) 8a 00 00 00 00 00 01 1a f0 00 00 00 00 80 00 00 [248374.167801] blk_update_request: I/O error, dev sdd, sector 18542592 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.167954] blk_update_request: I/O error, dev sdd, sector 18542720 op 0x1:(WRITE) flags 0x0 phys_seg 16 prio class 0 [248374.169024] sd 4:0:2:0: [sdd] tag#368 CDB: Write(16) 8a 00 00 00 00 00 01 1f a9 00 00 00 00 80 00 00 [248374.170392] blk_update_request: I/O error, dev sdd, sector 18855056 op 0x1:(WRITE) flags 0x0 phys_seg 14 prio class 0 [248374.211040] btrfs_dev_stat_print_on_error: 167 callbacks suppressed [248374.211044] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392712, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.213146] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392713, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214110] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392714, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.214237] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392715, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.215286] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392716, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.216309] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392717, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.217330] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392718, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.219443] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392719, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.220569] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392720, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.221699] BTRFS error (device sdg): bdev /dev/sdd errs: wr 74392721, rd 1756513, flush 193, corrupt 37086, gen 21 [248374.355125] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.355826] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.357122] BTRFS warning (device sdg): lost page write due to IO error on /dev/sdd (-5) [248374.389718] BTRFS error (device sdg): error writingprimary
super block to device 3