btrfs filesystem usage - Wrong Unallocated indications - RAID10
Hi,
as I wrote today in IRCI experienced an issue with 'btrfs filesystem usage'. I have a 4 partitions RAID10 btrfs filesystem almost full. 'btrfs filesystem usage' reports wrong "Unallocated" indications.
Linux 4.5.3
btrfs-progs v4.5.3
# btrfs fi usage /data/
Overall:
Device size: 13.93TiB
Device allocated: 13.77TiB
Device unallocated: 167.54GiB
Device missing: 0.00B
Used: 13.44TiB
Free (estimated): 244.39GiB (min: 244.39GiB)
Data ratio: 2.00
Metadata ratio: 2.00
Global reserve: 512.00MiB (used: 0.00B)
Data,single: Size:8.00MiB, Used:0.00B
/dev/sda4 8.00MiB
Data,RAID10: Size:6.87TiB, Used:6.71TiB
/dev/sda4 1.72TiB /dev/sdb3 1.72TiB /dev/sdc3 1.72TiB /dev/sdd3 1.72TiB
Metadata,single: Size:8.00MiB, Used:0.00B
/dev/sda4 8.00MiB
Metadata,RAID10: Size:19.00GiB, Used:14.15GiB
/dev/sda4 4.75GiB /dev/sdb3 4.75GiB /dev/sdc3 4.75GiB /dev/sdd3 4.75GiB
System,single: Size:4.00MiB, Used:0.00B
/dev/sda4 4.00MiB
System,RAID10: Size:16.00MiB, Used:768.00KiB
/dev/sda4 4.00MiB /dev/sdb3 4.00MiB /dev/sdc3 4.00MiB /dev/sdd3 4.00MiB
Unallocated:
/dev/sda4 1.76TiB /dev/sdb3 1.76TiB /dev/sdc3 1.76TiB /dev/sdd3 1.76TiB
----------------------------------------------------------------------------------
# btrfs fi show /data/
Label: 'data' uuid: df6639d5-3ef2-4ff6-a871-9ede440e2dae
Total devices 4 FS bytes used 6.72TiB
devid 1 size 3.48TiB used 3.44TiB path /dev/sda4
devid 2 size 3.48TiB used 3.44TiB path /dev/sdb3
devid 3 size 3.48TiB used 3.44TiB path /dev/sdc3
devid 4 size 3.48TiB used 3.44TiB path /dev/sdd3----------------------------------------------------------------------------------
# btrfs fi df /data/ Data, RAID10: total=6.87TiB, used=6.71TiB Data, single: total=8.00MiB, used=0.00B System, RAID10: total=16.00MiB, used=768.00KiB System, single: total=4.00MiB, used=0.00B Metadata, RAID10: total=19.00GiB, used=14.15GiB Metadata, single: total=8.00MiB, used=0.00B GlobalReserve, single: total=512.00MiB, used=0.00B
----------------------------------------------------------------------------------
# df -h /dev/sda4 7,0T 6,8T 245G 97% /data
Regards,
Signature · 16 lines
Marco Crociani Prisma Telecom Testing S.r.l. via Petrocchi, 4 20127 MILANO ITALY Phone: +39 02 26113507 Fax: +39 02 26113597 e-mail: [email protected] web: http://www.prismatelecomtesting.com Questa email (e I suoi allegati) costituisce informazione riservata e confidenziale e può essere soggetto a legal privilege. Può essere utilizzata esclusivamente dai suoi destinatari legittimi. Se avete ricevuto questa email per errore, siete pregati di informarne immediatamente il mittente e quindi cancellarla. A meno che non siate stati a ciò espressamente autorizzati, la diffusione o la riproduzione di questa email o del suo contenuto non sono consentiti. Salvo che questa email sia espressamente qualificata come offerta o accettazione contrattuale, il mittente non intende con questa email dare vita ad un vincolo giuridico e questa email non può essere interpretata quale offerta o accettazione che possa dare vita ad un contratto. Qualsiasi opinione manifestata in questa email è un'opinione personale del mittente, salvo che il mittente dichiari espressamente che si tratti di un'opinione di Prisma Engineering. ******************************************************************************* This e-mail (including any attachments) is private and confidential, and may be privileged. It is for the exclusive use of the intended recipient(s). If you have received this email in error, please inform the sender immediately and then delete this email. Unless you have been given specific permission to do so, please do not distribute or copy this email or its contents. Unless the text of this email specifically states that it is a contractual offer or acceptance, the sender does not intend to create a legal relationship and this email shall not constitute an offer or acceptance which could give rise to a contract. Any views expressed in this communication are those of the individual sender, except where the sender specifically states them to be the views of Prisma Engineering.
Quoted 9 lines · Marco Lorenzo Crociani
Hi,
as I wrote today in IRCI experienced an issue with 'btrfs filesystem usage'. I have a 4 partitions RAID10 btrfs filesystem almost full. 'btrfs filesystem usage' reports wrong "Unallocated" indications.Linux 4.5.3
btrfs-progs v4.5.3
Quoted 6 lines
# btrfs fi usage /data/Overall:
Device size: 13.93TiB
Device allocated: 13.77TiB
Device unallocated: 167.54GiB
I wonder if this is related to whatever caused the free space cache bug for Ivan Pilipenko and myself (linux 4.4.10, btrfs-progs 4.4.1)?
Cheers,
Nicholas
Quoted 76 lines · Marco Lorenzo Crociani
Hi,
as I wrote today in IRCI experienced an issue with 'btrfs filesystem usage'. I have a 4 partitions RAID10 btrfs filesystem almost full. 'btrfs filesystem usage' reports wrong "Unallocated" indications.Linux 4.5.3
btrfs-progs v4.5.3# btrfs fi usage /data/Overall:
Device size: 13.93TiB
Device allocated: 13.77TiB
Device unallocated: 167.54GiB
Device missing: 0.00B
Used: 13.44TiB
Free (estimated): 244.39GiB (min: 244.39GiB)
Data ratio: 2.00
Metadata ratio: 2.00
Global reserve: 512.00MiB (used: 0.00B)Data,single: Size:8.00MiB, Used:0.00B
/dev/sda48.00MiBData,RAID10: Size:6.87TiB, Used:6.71TiB
/dev/sda4 1.72TiB /dev/sdb3 1.72TiB /dev/sdc3 1.72TiB /dev/sdd3 1.72TiBMetadata,single: Size:8.00MiB, Used:0.00B
/dev/sda48.00MiBMetadata,RAID10: Size:19.00GiB, Used:14.15GiB
/dev/sda4 4.75GiB /dev/sdb3 4.75GiB /dev/sdc3 4.75GiB /dev/sdd3 4.75GiBSystem,single: Size:4.00MiB, Used:0.00B
/dev/sda44.00MiBSystem,RAID10: Size:16.00MiB, Used:768.00KiB
/dev/sda4 4.00MiB /dev/sdb3 4.00MiB /dev/sdc3 4.00MiB /dev/sdd3 4.00MiBUnallocated:
/dev/sda4 1.76TiB /dev/sdb3 1.76TiB /dev/sdc3 1.76TiB /dev/sdd3 1.76TiB----------------------------------------------------------------------------------
# btrfs fi show /data/ Label: 'data' uuid: df6639d5-3ef2-4ff6-a871-9ede440e2dae Total devices 4 FS bytes used 6.72TiB devid 1 size 3.48TiB used 3.44TiB path /dev/sda4 devid 2 size 3.48TiB used 3.44TiB path /dev/sdb3 devid 3 size 3.48TiB used 3.44TiB path /dev/sdc3 devid 4 size 3.48TiB used 3.44TiB path /dev/sdd3----------------------------------------------------------------------------------
# btrfs fi df /data/ Data, RAID10: total=6.87TiB, used=6.71TiB Data, single: total=8.00MiB, used=0.00B System, RAID10: total=16.00MiB, used=768.00KiB System, single: total=4.00MiB, used=0.00B Metadata, RAID10: total=19.00GiB, used=14.15GiB Metadata, single: total=8.00MiB, used=0.00B GlobalReserve, single: total=512.00MiB, used=0.00B
Quoted 7 lines
----------------------------------------------------------------------------------
# df -h /dev/sda4 7,0T 6,8T 245G 97% /dataRegards,
For what it's worth... I have a 8 disk (7x 300GB + 1x 500GB) data raid10, metadata raid1 setup and I get the following output of btrfs...
Label: 'xxyyzz' uuid: 12345678-9abc-def1-2345-6789abcdef01
Total devices 8 FS bytes used 1.05TiB
devid 1 size 268.05GiB used 265.94GiB path /dev/sda1
devid 2 size 279.40GiB used 277.22GiB path /dev/sdb
devid 3 size 279.40GiB used 277.32GiB path /dev/sdc
devid 4 size 279.40GiB used 278.73GiB path /dev/sdd
devid 5 size 279.40GiB used 277.72GiB path /dev/sde
devid 6 size 279.40GiB used 278.61GiB path /dev/sdf
devid 7 size 279.40GiB used 278.82GiB path /dev/sdg
devid 8 size 465.76GiB used 230.99GiB path /dev/sdh# btrfs filesystem usage -T /
Overall:
Device size: 2.35TiB
Device allocated: 2.11TiB
Device unallocated: 244.83GiB
Device missing: 0.00B
Used: 2.11TiB
Free (estimated): 122.57GiB (min: 122.57GiB)
Data ratio: 2.00
Metadata ratio: 2.00
Global reserve: 512.00MiB (used: 0.00B)Data Data Metadata System Id Path RAID1 RAID10 RAID1 RAID1 Unallocated -- --------- ---------- --------- -------- --------- ----------- 1 /dev/sda1 - 132.97GiB - - 135.08GiB 2 /dev/sdb - 138.61GiB - - 140.79GiB 3 /dev/sdc - 138.66GiB - - 140.74GiB 4 /dev/sdd - 138.87GiB 1.00GiB - 139.53GiB 5 /dev/sde 1.00GiB 137.86GiB 1.00GiB - 139.53GiB 6 /dev/sdf - 138.81GiB 1.00GiB - 139.59GiB 7 /dev/sdg 1.00GiB 138.38GiB 1.00GiB 64.00MiB 138.96GiB 8 /dev/sdh - 113.46GiB 4.00GiB 64.00MiB 348.24GiB
-- --------- ---------- --------- -------- --------- -----------
Total 1.00GiB 1.05TiB 4.00GiB 64.00MiB 1.29TiB
Used 1007.30MiB 1.05TiB 1.66GiB 400.00KiB
What I don't get is... how can I have 244.8 GB unallocated when the table below clearly shows that there is as much as 1.29TiB unallocated.... does not appear to make sense to me at least...
On Mon, May 23, 2016 at 08:49:04PM +0200, Zoiled wrote:
[snip]
Quoted 38 lines
For what it's worth... I have a 8 disk (7x 300GB + 1x 500GB) data raid10, metadata raid1 setup and I get the following output of btrfs...
Label: 'xxyyzz' uuid: 12345678-9abc-def1-2345-6789abcdef01
Total devices 8 FS bytes used 1.05TiB devid 1 size 268.05GiB used 265.94GiB path /dev/sda1 devid 2 size 279.40GiB used 277.22GiB path /dev/sdb devid 3 size 279.40GiB used 277.32GiB path /dev/sdc devid 4 size 279.40GiB used 278.73GiB path /dev/sdd devid 5 size 279.40GiB used 277.72GiB path /dev/sde devid 6 size 279.40GiB used 278.61GiB path /dev/sdf devid 7 size 279.40GiB used 278.82GiB path /dev/sdg devid 8 size 465.76GiB used 230.99GiB path /dev/sdh# btrfs filesystem usage -T / Overall: Device size: 2.35TiB Device allocated: 2.11TiB Device unallocated: 244.83GiB Device missing: 0.00B Used: 2.11TiB Free (estimated): 122.57GiB (min: 122.57GiB) Data ratio: 2.00 Metadata ratio: 2.00 Global reserve: 512.00MiB (used: 0.00B)Data Data Metadata System Id Path RAID1 RAID10 RAID1 RAID1 Unallocated -- --------- ---------- --------- -------- --------- ----------- 1 /dev/sda1 - 132.97GiB - - 135.08GiB 2 /dev/sdb - 138.61GiB - - 140.79GiB 3 /dev/sdc - 138.66GiB - - 140.74GiB 4 /dev/sdd - 138.87GiB 1.00GiB - 139.53GiB 5 /dev/sde 1.00GiB 137.86GiB 1.00GiB - 139.53GiB 6 /dev/sdf - 138.81GiB 1.00GiB - 139.59GiB 7 /dev/sdg 1.00GiB 138.38GiB 1.00GiB 64.00MiB 138.96GiB 8 /dev/sdh - 113.46GiB 4.00GiB 64.00MiB 348.24GiB
Quoted 7 lines
-- --------- ---------- --------- -------- --------- -----------
Total 1.00GiB 1.05TiB 4.00GiB 64.00MiB 1.29TiB
Used 1007.30MiB 1.05TiB 1.66GiB 400.00KiBWhat I don't get is... how can I have 244.8 GB unallocated when the table below clearly shows that there is as much as 1.29TiB unallocated.... does not appear to make sense to me at least...
This is exactly the issue. The Unallocated value(s) from btrfs fi
usage on at least RAID-10 are simply wrong, any way you look at it.
Hugo.
Signature · 4 lines
Hugo Mills | Great films about cricket: The Third Man hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 |
There is a division by 2 missing in the code. With that added, the RAID10 numbers make more sense. See also:
http://permalink.gmane.org/gmane.comp.file-systems.btrfs/53989
More detail in here:
https://www.spinics.net/lists/linux-btrfs/msg52882.html
And if you want to look at allocation in a different way, this might be interesting:
https://github.com/knorrie/btrfs-heatmap/blob/master/show_usage.py
Quoted 125 lines · Marco Lorenzo Crociani
Hi,
as I wrote today in IRCI experienced an issue with 'btrfs filesystem usage'. I have a 4 partitions RAID10 btrfs filesystem almost full. 'btrfs filesystem usage' reports wrong "Unallocated" indications.Linux 4.5.3
btrfs-progs v4.5.3# btrfs fi usage /data/Overall:
Device size: 13.93TiB
Device allocated: 13.77TiB
Device unallocated: 167.54GiB
Device missing: 0.00B
Used: 13.44TiB
Free (estimated): 244.39GiB (min: 244.39GiB)
Data ratio: 2.00
Metadata ratio: 2.00
Global reserve: 512.00MiB (used: 0.00B)Data,single: Size:8.00MiB, Used:0.00B
/dev/sda48.00MiBData,RAID10: Size:6.87TiB, Used:6.71TiB
/dev/sda4 1.72TiB /dev/sdb3 1.72TiB /dev/sdc3 1.72TiB /dev/sdd3 1.72TiBMetadata,single: Size:8.00MiB, Used:0.00B
/dev/sda48.00MiBMetadata,RAID10: Size:19.00GiB, Used:14.15GiB
/dev/sda4 4.75GiB /dev/sdb3 4.75GiB /dev/sdc3 4.75GiB /dev/sdd3 4.75GiBSystem,single: Size:4.00MiB, Used:0.00B
/dev/sda44.00MiBSystem,RAID10: Size:16.00MiB, Used:768.00KiB
/dev/sda4 4.00MiB /dev/sdb3 4.00MiB /dev/sdc3 4.00MiB /dev/sdd3 4.00MiBUnallocated:
/dev/sda4 1.76TiB /dev/sdb3 1.76TiB /dev/sdc3 1.76TiB /dev/sdd3 1.76TiB----------------------------------------------------------------------------------
# btrfs fi show /data/ Label: 'data' uuid: df6639d5-3ef2-4ff6-a871-9ede440e2dae Total devices 4 FS bytes used 6.72TiB devid 1 size 3.48TiB used 3.44TiB path /dev/sda4 devid 2 size 3.48TiB used 3.44TiB path /dev/sdb3 devid 3 size 3.48TiB used 3.44TiB path /dev/sdc3 devid 4 size 3.48TiB used 3.44TiB path /dev/sdd3----------------------------------------------------------------------------------
# btrfs fi df /data/ Data, RAID10: total=6.87TiB, used=6.71TiB Data, single: total=8.00MiB, used=0.00B System, RAID10: total=16.00MiB, used=768.00KiB System, single: total=4.00MiB, used=0.00B Metadata, RAID10: total=19.00GiB, used=14.15GiB Metadata, single: total=8.00MiB, used=0.00B GlobalReserve, single: total=512.00MiB, used=0.00B----------------------------------------------------------------------------------
# df -h /dev/sda4 7,0T 6,8T 245G 97% /dataRegards,
--
Marco Crociani
Prisma Telecom Testing S.r.l.
via Petrocchi, 4 20127 MILANO ITALYPhone: +39 02 26113507 Fax: +39 02 26113597 e-mail: [email protected] web: http://www.prismatelecomtesting.comQuesta email (e I suoi allegati) costituisce informazione riservata e confidenziale e può essere soggetto a legal privilege. Può essere utilizzata esclusivamente dai suoi destinatari legittimi. Se avete ricevuto questa email per errore, siete pregati di informarne immediatamente il mittente e quindi cancellarla. A meno che non siate stati a ciò espressamente autorizzati, la diffusione o la riproduzione di questa email o del suo contenuto non sono consentiti.
Salvo che questa email sia espressamente qualificata come offerta o
accettazione contrattuale, il mittente non intende con questa email dare vita ad un vincolo giuridico e questa email non può essere interpretata quale offerta o accettazione che possa dare vita ad un contratto. Qualsiasi opinione manifestata in questa email è un'opinione personale del mittente, salvo che il mittente dichiari espressamente che si tratti di un'opinione di Prisma Engineering.*******************************************************************************
This e-mail (including any attachments) is private and confidential, and
may be privileged. It is for the exclusive use of the intended recipient(s). If you have received this email in error, please inform the sender immediately and then delete this email. Unless you have been given specific permission to do so, please do not distribute or copy this email or its contents.
Unless the text of this email specifically states that it is a contractual
offer or acceptance, the sender does not intend to create a legal relationship and this email shall not constitute an offer or acceptance which could give rise to a contract. Any views expressed in this communication are those of the individual sender, except where the sender specifically states them to be the views of Prisma Engineering.--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html