Skip to contentSkip to conversation

some issues with lots of snapshots

DISCUSSION Xavier Nicollet 3 participants 6 messages Oct 26, 2010 – Oct 30, 2010 Btrfs file system

lore
Share & tools
lore
#0 lore raw

I can't reproduce this right know, but it seems that creating lots of snapshots, one per minute (keeping only a dozens of them) may block the system. Every btrfs snap processes stay idle and the load skyrockets to 900.

I use an old version: 2.6.34.5 kernel, and the system is still very responsive (web and mysql server).

I would apreciate if somebody could tell me about the current kernel (I had stability issues with 2.6.35 series).

# btrfs filesys show
Label: 'btrfs'  uuid: e13357f4-c40c-4940-87bd-4f5142d32c49
        Total devices 2 FS bytes used 8.67GB
        devid    1 size 1.81TB used 12.03GB path /dev/sda2
        devid    2 size 1.81TB used 12.01GB path /dev/sdb2
# btrfs filesys df /var
Data, RAID1: total=11.00GB, used=8.24GB
Metadata, RAID1: total=1.00GB, used=436.21MB
System, RAID1: total=8.00MB, used=4.00KB
Data: total=8.00MB, used=0.00
Metadata: total=8.00MB, used=0.00
System: total=4.00MB, used=0.00

Regards,

PS: extract from dmesg if somebody is interested.
http://pastebin.com/8zE4GKXu

Signature · 1 line
Xavier Nicollet
#1 lore raw
Quoted 7 lines · On Tue, 26 Oct 2010 12:28:53 +0200 Xavier Nicollet <[email protected]> wrote:

I can't reproduce this right know, but it seems that creating lots of snapshots, one per minute (keeping only a dozens of them) may block the system. Every btrfs snap processes stay idle and the load skyrockets to 900.

I use an old version: 2.6.34.5 kernel, and the system is still very responsive (web and mysql server).

I had the same thing happen with a 2.6.36-rc6 kernel on my laptop. My cron jobs were creating snapshots and 5 minute intervals and keeping 12 of them active.

I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.

Pat

#2 lore raw

Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:

Quoted 1 line

I turned off the 5-minute snapshots and I'm now just keeping 4 weekly=

, 7

Quoted 1 line

daily, and 24 hourly snapshots alive.

I have just rebooted and I am going with /15 minutes interval.

--=20
Xavier Nicollet
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#3 lore raw
Quoted 6 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:

Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:

Quoted 2 lines

I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.

=20
I have just rebooted and I am going with /15 minutes interval. =20

I'm just replying so this is documented somewhere.

After I read your message I decided to turn on snaphots at 15 minute intervals yesterday. This morning I had snapshot processing filling up my process list again.

My laptop is a quad core i7 and the btrfs file system is on an Intel X25-M 80 gig. I don't know if a fast drives increases or decreases the likelihood of having this problem or not.

Pat
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#4 lore raw
Quoted 7 lines · Pat Regan
Quoted 4 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:

Le 26 octobre 2010 =C3=A0 15:15, Pat Regan a =C3=A9crit:

Quoted 2 lines

I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.

Quoted 7 lines
Quoted 2 lines

I have just rebooted and I am going with /15 minutes interval.

I'm just replying so this is documented somewhere.

After I read your message I decided to turn on snaphots at 15 minute intervals yesterday. =C2=A0This morning I had snapshot processing fil=

ling up

Quoted 1 line

my process list again.

I think there is no problem with snapshot creation every 5 or 15 minutes, but problem is with deleting old snapshots every 5 or 15 minutes. Can you try to run cleanup of old snapshots only once per day to check if it will improve?

Quoted 3 lines

My laptop is a quad core i7 and the btrfs file system is on an Intel X25-M 80 gig. =C2=A0I don't know if a fast drives increases or decrea=

ses the

Quoted 4 lines

likelihood of having this problem or not.

Pat

--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#5 lore raw
Quoted 1 line · On Fri, 29 Oct 2010 08:31:05 +0200 Roman Kapusta <[email protected]>…

On Fri, Oct 29, 2010 at 00:03, Pat Regan <[email protected]> wrote=

:

Quoted 7 lines
Quoted 7 lines
Quoted 4 lines · On Wed, 27 Oct 2010 10:39:48 +0200 Xavier Nicollet <[email protected]> wrote:

Le 26 octobre 2010 =E0 15:15, Pat Regan a =E9crit:

Quoted 2 lines

I turned off the 5-minute snapshots and I'm now just keeping 4 weekly, 7 daily, and 24 hourly snapshots alive.

Quoted 6 lines
Quoted 6 lines
Quoted 2 lines

I have just rebooted and I am going with /15 minutes interval.

I'm just replying so this is documented somewhere.

After I read your message I decided to turn on snaphots at 15 minut=

e

Quoted 6 lines
Quoted 2 lines

intervals yesterday. =A0This morning I had snapshot processing filling up my process list again.

=20
I think there is no problem with snapshot creation every 5 or 15 minutes, but problem is with deleting old snapshots every 5 or 15 minutes. Can you try to run cleanup of old snapshots only once per da=

y

Quoted 1 line

to check if it will improve?

Reducing the frequency of snapshot removal sure did work. I started with a pretty large amount of time between snapshot removal jobs and I have been decreasing that number. I have been running with a 1 hour delay between snapshot removals for almost 24 hours so far with no problems.

Pat
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html