some issues with lots of snapshots
I can't reproduce this right know, but it seems that creating lots of snapshots, one per minute (keeping only a dozens of them) may block the system. Every btrfs snap processes stay idle and the load skyrockets to 900.
I use an old version: 2.6.34.5 kernel, and the system is still very responsive (web and mysql server).
I would apreciate if somebody could tell me about the current kernel (I had stability issues with 2.6.35 series).
# btrfs filesys show
Label: 'btrfs' uuid: e13357f4-c40c-4940-87bd-4f5142d32c49
Total devices 2 FS bytes used 8.67GB
devid 1 size 1.81TB used 12.03GB path /dev/sda2
devid 2 size 1.81TB used 12.01GB path /dev/sdb2# btrfs filesys df /var Data, RAID1: total=11.00GB, used=8.24GB Metadata, RAID1: total=1.00GB, used=436.21MB System, RAID1: total=8.00MB, used=4.00KB Data: total=8.00MB, used=0.00 Metadata: total=8.00MB, used=0.00 System: total=4.00MB, used=0.00
Regards,
PS: extract from dmesg if somebody is interested.
http://pastebin.com/8zE4GKXu
Signature · 1 line
Xavier Nicollet
Quoted 7 lines · On Tue, 26 Oct 2010 12:28:53 +0200 Xavier Nicollet <[email protected]> wrote:
I can't reproduce this right know, but it seems that creating lots of snapshots, one per minute (keeping only a dozens of them) may block the system. Every btrfs snap processes stay idle and the load skyrockets to 900.
I use an old version: 2.6.34.5 kernel, and the system is still very responsive (web and mysql server).
I had the same thing happen with a 2.6.36-rc6 kernel on my laptop. My cron jobs were creating snapshots and 5 minute intervals and keeping 12 of them active.
I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.
Pat
Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:
Quoted 1 line
I turned off the 5-minute snapshots and I'm now just keeping 4 weekly=
, 7
Quoted 1 line
daily, and 24 hourly snapshots alive.
I have just rebooted and I am going with /15 minutes interval.
--=20
Xavier Nicollet
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 6 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:
Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:
Quoted 2 lines
I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.
=20
I have just rebooted and I am going with /15 minutes interval. =20
I'm just replying so this is documented somewhere.
After I read your message I decided to turn on snaphots at 15 minute intervals yesterday. This morning I had snapshot processing filling up my process list again.
My laptop is a quad core i7 and the btrfs file system is on an Intel X25-M 80 gig. I don't know if a fast drives increases or decreases the likelihood of having this problem or not.
Pat
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 7 lines · Pat Regan
Quoted 4 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:
Le 26 octobre 2010 =C3=A0 15:15, Pat Regan a =C3=A9crit:
Quoted 2 lines
I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.
Quoted 7 lines
Quoted 2 lines
I have just rebooted and I am going with /15 minutes interval.
I'm just replying so this is documented somewhere.
After I read your message I decided to turn on snaphots at 15 minute intervals yesterday. =C2=A0This morning I had snapshot processing fil=
ling up
Quoted 1 line
my process list again.
I think there is no problem with snapshot creation every 5 or 15 minutes, but problem is with deleting old snapshots every 5 or 15 minutes. Can you try to run cleanup of old snapshots only once per day to check if it will improve?
Quoted 3 lines
My laptop is a quad core i7 and the btrfs file system is on an Intel X25-M 80 gig. =C2=A0I don't know if a fast drives increases or decrea=
ses the
Quoted 4 lines
likelihood of having this problem or not.
Pat
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 1 line · On Fri, 29 Oct 2010 08:31:05 +0200 Roman Kapusta <[email protected]>…
On Fri, Oct 29, 2010 at 00:03, Pat Regan <[email protected]> wrote=
:
Quoted 7 lines
Quoted 7 lines
Quoted 4 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:
Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:
Quoted 2 lines
I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.
Quoted 6 lines
Quoted 6 lines
Quoted 2 lines
I have just rebooted and I am going with /15 minutes interval.
I'm just replying so this is documented somewhere.
After I read your message I decided to turn on snaphots at 15 minut=
e
Quoted 6 lines
Quoted 2 lines
intervals yesterday. =A0This morning I had snapshot processing filling up my process list again.
=20
I think there is no problem with snapshot creation every 5 or 15 minutes, but problem is with deleting old snapshots every 5 or 15 minutes. Can you try to run cleanup of old snapshots only once per da=
y
Quoted 1 line
to check if it will improve?
Reducing the frequency of snapshot removal sure did work. I started with a pretty large amount of time between snapshot removal jobs and I have been decreasing that number. I have been running with a 1 hour delay between snapshot removals for almost 24 hours so far with no problems.
Pat
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html