Skip to contentSkip to conversation

f2fs: check return value of write_checkpoint during fstrim

PATCH In review Chao Yu 3 participants 8 messages Aug 21, 2016 – Aug 26, 2016 F2FS file system

lore
Share & tools
lore

Chao Yu

author maintainer
#0 lore raw

PATCH 1/3 f2fs: check return value of write_checkpoint during fstrim

From: Chao Yu <[email protected]>

During fstrim, if one of multiple write_checkpoint failed, break off and return error number to caller.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
fs/f2fs/segment.c +2 -0
index a394012..020767c 100644
@@ -1303,6 +1303,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_lock(&sbi->gc_mutex);
 		err = write_checkpoint(sbi, &cpc);
 		mutex_unlock(&sbi->gc_mutex);
+		if (err)
+			break;
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2
author maintainer
#1 lore raw

PATCH 2/3 f2fs: schedule in between two continous batch discards

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
fs/f2fs/segment.c +2 -0
index 020767c..d0f74eb 100644
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2
maintainer
#2 lore raw

Re: [PATCH 2/3] f2fs: schedule in between two continous batch discards

Hi Chao,

Quoted 19 lines · Chao Yu

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
fs/f2fs/segment.c +0 -0
index 020767c..d0f74eb 100644

fs/f2fs/segment.c int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range) · line 1309

Quoted 5 lines
fs/f2fs/segment.c +2 -0
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();

Hmm, if other thread is already waiting for gc_mutex, we don't need this here. In order to avoid long latency, wouldn't it be enough to reduce the batch size?

Thanks,

Quoted 5 lines
fs/f2fs/segment.c +0 -0
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2

------------------------------------------------------------------------------

#3 lore raw

Re: [PATCH 2/3] f2fs: schedule in between two continous batch discards

Hi Jaegeuk,

Quoted 17 lines · Jaegeuk Kim

Hi Chao,

Quoted 14 lines · Chao Yu

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
Quoted 13 lines

fs/f2fs/segment.c int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range) · line 1309

Quoted 10 lines
fs/f2fs/segment.c +2 -0
index 020767c..d0f74eb 100644
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();

Hmm, if other thread is already waiting for gc_mutex, we don't need this here. In order to avoid long latency, wouldn't it be enough to reduce the batch size?

Hmm, when fstrim call mutex_unlock we will pop one blocked locker from FIFO list of mutex lock, and wake it up, then fstrimer will try to lock gc_mutex for next batch trim, so the popped locker and fstrimer will make a new competition in gc_mutex. If fstrimer is running in a big core, and popped locker is running in a small core, we can't guarantee popped locker can win the race, and for the most of time, fstrimer will win. So in order to reduce starvation of other gc_mutext locker, it's better to do schedule() here.

Thanks,

Quoted 11 lines

Thanks,

Quoted 5 lines
fs/f2fs/segment.c +0 -0
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2

.

maintainer
#4 lore raw

Re: [PATCH 2/3] f2fs: schedule in between two continous batch discards

Hi Chao,

Quoted 34 lines · Chao Yu

Hi Jaegeuk,

Quoted 17 lines · Jaegeuk Kim

Hi Chao,

Quoted 14 lines · Chao Yu

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
Quoted 13 lines

fs/f2fs/segment.c int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range) · line 1309

Quoted 10 lines
fs/f2fs/segment.c +2 -0
index 020767c..d0f74eb 100644
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();

Hmm, if other thread is already waiting for gc_mutex, we don't need this here. In order to avoid long latency, wouldn't it be enough to reduce the batch size?

Quoted 4 lines

Hmm, when fstrim call mutex_unlock we will pop one blocked locker from FIFO list of mutex lock, and wake it up, then fstrimer will try to lock gc_mutex for next batch trim, so the popped locker and fstrimer will make a new competition in gc_mutex.

Before trying to grab gc_mutex by fstrim again, there are already blocked tasks waiting for gc_mutex. Hence the next one should be selectec by FIFO, no?

Thanks,

Quoted 5 lines

If fstrimer is running in a big core, and popped locker is running in a small core, we can't guarantee popped locker can win the race, and for the most of time, fstrimer will win. So in order to reduce starvation of other gc_mutext locker, it's better to do schedule() here.

Quoted 13 lines

Thanks,

Quoted 11 lines

Thanks,

Quoted 5 lines
fs/f2fs/segment.c +0 -0
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2

.

------------------------------------------------------------------------------

#5 lore raw

Re: [PATCH 2/3] f2fs: schedule in between two continous batch discards

Hi Jaegeuk,

Quoted 37 lines · Jaegeuk Kim

Hi Chao,

Quoted 34 lines · Chao Yu

Hi Jaegeuk,

Quoted 30 lines · Jaegeuk Kim

Hi Chao,

Quoted 19 lines · Chao Yu

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
fs/f2fs/segment.c +0 -0
index 020767c..d0f74eb 100644

fs/f2fs/segment.c int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range) · line 1309

Quoted 5 lines
fs/f2fs/segment.c +2 -0
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();

Hmm, if other thread is already waiting for gc_mutex, we don't need this here. In order to avoid long latency, wouldn't it be enough to reduce the batch size?

Quoted 7 lines
Quoted 4 lines

Hmm, when fstrim call mutex_unlock we will pop one blocked locker from FIFO list of mutex lock, and wake it up, then fstrimer will try to lock gc_mutex for next batch trim, so the popped locker and fstrimer will make a new competition in gc_mutex.

Before trying to grab gc_mutex by fstrim again, there are already blocked tasks waiting for gc_mutex. Hence the next one should be selectec by FIFO, no?

The next one which is going to be waked up is selected by FIFO, but the waked one is still needs to be race with other mutex lock grabber.

So there is no such guarantee that the waked one must get the lock.

Thanks,

Quoted 24 lines

Thanks,

Quoted 5 lines

If fstrimer is running in a big core, and popped locker is running in a small core, we can't guarantee popped locker can win the race, and for the most of time, fstrimer will win. So in order to reduce starvation of other gc_mutext locker, it's better to do schedule() here.

Quoted 13 lines

Thanks,

Quoted 11 lines

Thanks,

Quoted 5 lines
fs/f2fs/segment.c +0 -0
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2

.

.

maintainer
#6 lore raw

Re: [PATCH 2/3] f2fs: schedule in between two continous batch discards

Quoted 45 lines · Chao Yu

Hi Jaegeuk,

Quoted 42 lines · Jaegeuk Kim

Hi Chao,

Quoted 38 lines · Chao Yu

Hi Jaegeuk,

Quoted 17 lines · Jaegeuk Kim

Hi Chao,

Quoted 14 lines · Chao Yu

From: Chao Yu <[email protected]>

In batch discard approach of fstrim will grab/release gc_mutex lock repeatly, it makes contention of the lock becoming more intensive.

So after one batch discards were issued in checkpoint and the lock was released, it's better to do schedule() to increase opportunity of grabbing gc_mutex lock for other competitors.

---
 fs/f2fs/segment.c | 2 ++
 1 file changed, 2 insertions(+)
Quoted 13 lines

fs/f2fs/segment.c int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range) · line 1309

Quoted 10 lines
fs/f2fs/segment.c +2 -0
index 020767c..d0f74eb 100644
@@ -1305,6 +1305,8 @@ int f2fs_trim_fs(struct f2fs_sb_info *sbi, struct fstrim_range *range)
 		mutex_unlock(&sbi->gc_mutex);
 		if (err)
 			break;
+
+		schedule();

Hmm, if other thread is already waiting for gc_mutex, we don't need this here. In order to avoid long latency, wouldn't it be enough to reduce the batch size?

Hmm, when fstrim call mutex_unlock we will pop one blocked locker from FIFO list of mutex lock, and wake it up, then fstrimer will try to lock gc_mutex for next batch trim, so the popped locker and fstrimer will make a new competition in gc_mutex.

Quoted 7 lines
Quoted 2 lines

Before trying to grab gc_mutex by fstrim again, there are already blocked tasks waiting for gc_mutex. Hence the next one should be selectec by FIFO, no?

The next one which is going to be waked up is selected by FIFO, but the waked one is still needs to be race with other mutex lock grabber.

So there is no such guarantee that the waked one must get the lock.

Okay, I'll merge this. :)

Thanks,

Quoted 27 lines

Thanks,

Quoted 24 lines

Thanks,

Quoted 5 lines

If fstrimer is running in a big core, and popped locker is running in a small core, we can't guarantee popped locker can win the race, and for the most of time, fstrimer will win. So in order to reduce starvation of other gc_mutext locker, it's better to do schedule() here.

Quoted 13 lines

Thanks,

Quoted 11 lines

Thanks,

Quoted 5 lines
fs/f2fs/segment.c +0 -0
 	}
 out:
 	range->len = F2FS_BLK_TO_BYTES(cpc.trimmed);
Signature · 1 line
2.7.2

.

.

------------------------------------------------------------------------------

author maintainer
#7 lore raw

PATCH 3/3 f2fs: remove redundant judgement condition in available_free_memory

In reply to Chao Yu

From: Chao Yu <[email protected]>

In available_free_memory, there are two same judgement conditions which is used for checking NAT excess, remove one of them.

---
 fs/f2fs/node.c | 2 --
 1 file changed, 2 deletions(-)
fs/f2fs/node.c +0 -2
index f75d197..8a28800 100644
@@ -54,8 +54,6 @@ bool available_free_memory(struct f2fs_sb_info *sbi, int type)
 		res = mem_size < ((avail_ram * nm_i->ram_thresh / 100) >> 2);
 		if (excess_cached_nats(sbi))
 			res = false;
-		if (nm_i->nat_cnt > DEF_NAT_CACHE_THRESHOLD)
-			res = false;
 	} else if (type == DIRTY_DENTS) {
 		if (sbi->sb->s_bdi->wb.dirty_exceeded)
 			return false;
Signature · 4 lines
2.7.2


------------------------------------------------------------------------------