zram: correct offset usage in zram_bio_discard
Subsystems (2)
PATCH RESEND 1/1 zram: correct offset usage in zram_bio_discard
We want to skip the physical block(PAGE_SIZE) which is partially covered by the discard bio, so we check the remaining size and subtract it if there is a need to goto the next physical block.
The current offset usage in zram_bio_discard is incorrect, it will cause its upper filesystem breakdown.
Consider the following scenario:
on some architecture or config, PAGE_SIZE is 64K for example, filesystem is set up on zram disk without PAGE_SIZE aligned,
a discard bio leads to a offset = 4K and size=72K,
normally, it should not really discard any physical block as it partially cover two physical blocks.
However, with the current offset usage, it will discard the second physical block and free its memory, which will cause filesystem breakdown.
This patch corrects the offset usage in zram_bio_discard.
--- drivers/block/zram/zram_drv.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
drivers/block/zram/zram_drv.c +2 -2
@@ -572,10 +572,10 @@ static void zram_bio_discard(struct zram *zram, u32 index,* skipping this logical block is appropriate here. */ if (offset) { -if (n < offset) +if (n <= (PAGE_SIZE - offset))return ; - n -= offset; + n -= (PAGE_SIZE - offset); index++; }
Signature · 1 line
1.7.10.4
Minchan Kim
maintainerHello,
Quoted 15 lines · Weijie Yang
We want to skip the physical
block(PAGE_SIZE)which is partially covered by the discard bio, so we check the remaining size and subtract it if there is a need to goto the next physical block.The current offset usage in
zram_bio_discardis incorrect, it will cause its upper filesystem breakdown.
Consider the following scenario:
on some architecture or config,PAGE_SIZEis 64K for example, filesystem is set up on zram disk withoutPAGE_SIZEaligned,
a discard bio leads to a offset = 4K and size=72K,
normally, it should not really discard any physical block as it partially cover two physical blocks.
However, with the current offset usage, it will discard the second physical block and free its memory, which will cause filesystem breakdown.
Quoted 1 line
This patch corrects the offset usage in
zram_bio_discard.
Nice catch.
Surely we need fix but I'd like to go further. Let's think. How do you find that? Real problem or code review?
I'd like to know how much that happens in real practice because if it's a lot, it means discard support is just an overhead without any benefit.
If you just found it with code review(ie, don't have any data), would you mind adding some stat like 'num_discard/failed_discard' so we can keep an eye on that. Although it's for rare case, I think it's worth. Because someone would do swapon zram with --discard,
it could make same problem due to early page freeing of zram-swap to avoid duplicating VM-owned memory and ZRAM-owned memory.
We can guide to zram-swap user not to use swapon with --discard but I don't want it because swap_slot_free_notify is really mess which violates layering so I hope replace it with discard finally so such statistics really help us to drive that way more quickly.
Quoted 33 lines
Signed-off-by Weijie Yang <[email protected]>Acked-by Joonsoo Kim <[email protected]>--- drivers/block/zram/zram_drv.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)drivers/block/zram/zram_drv.c +2
-2@@ -572,10 +572,10 @@ static void zram_bio_discard(struct zram *zram, u32 index,* skipping this logical block is appropriate here. */ if (offset) { -if (n < offset) +if (n <= (PAGE_SIZE - offset))return ; - n -= offset; + n -= (PAGE_SIZE - offset); index++; }Signature · 8 lines
1.7.10.4 -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Signature · 2 lines
Kind regards, Minchan Kim
Hello Minchan,
Quoted 33 lines · Minchan Kim
Hello,
Quoted 15 lines · Weijie Yang
We want to skip the physical
block(PAGE_SIZE)which is partially covered by the discard bio, so we check the remaining size and subtract it if there is a need to goto the next physical block.The current offset usage in
zram_bio_discardis incorrect, it will cause its upper filesystem breakdown.
Consider the following scenario:
on some architecture or config,PAGE_SIZEis 64K for example, filesystem is set up on zram disk withoutPAGE_SIZEaligned,
a discard bio leads to a offset = 4K and size=72K,
normally, it should not really discard any physical block as it partially cover two physical blocks.
However, with the current offset usage, it will discard the second physical block and free its memory, which will cause filesystem breakdown.Quoted 1 line
This patch corrects the offset usage in
zram_bio_discard.Nice catch.
Surely we need fix but I'd like to go further. Let's think. How do you find that? Real problem or code review?
I'd like to know how much that happens in real practice because if it's a lot, it means discard support is just an overhead without any benefit.If you just found it with code
review(ie, don't have any data), would you mind adding some stat like 'num_discard/failed_discard' so we can keep an eye on that. Although it's for rare case, I think it's worth. Because someone would do swapon zram with --discard,
it could make same problem due to early page freeing of zram-swap to avoid duplicating VM-owned memory and ZRAM-owned memory.
Quoted 5 lines
We can guide to zram-swap user not to use swapon with --discard but I don't want it because
swap_slot_free_notifyis really mess which violates layering so I hope replace it with discard finally so such statistics really help us to drive that way more quickly.
I second this. if we could drop swap_slot_free_notify that'd be nice.
-ss
Quoted 38 lines
Quoted 33 lines
Signed-off-by Weijie Yang <[email protected]>Acked-by Joonsoo Kim <[email protected]>--- drivers/block/zram/zram_drv.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)drivers/block/zram/zram_drv.c +2
-2@@ -572,10 +572,10 @@ static void zram_bio_discard(struct zram *zram, u32 index,* skipping this logical block is appropriate here. */ if (offset) { -if (n < offset) +if (n <= (PAGE_SIZE - offset))return ; - n -= offset; + n -= (PAGE_SIZE - offset); index++; }Signature · 8 lines
1.7.10.4 -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/Signature · 2 lines
Kind regards, Minchan Kim
Quoted 41 lines · Sergey Senozhatsky
Hello Minchan,
Quoted 38 lines · Minchan Kim
Hello,
Quoted 15 lines · Weijie Yang
We want to skip the physical
block(PAGE_SIZE)which is partially covered by the discard bio, so we check the remaining size and subtract it if there is a need to goto the next physical block.The current offset usage in
zram_bio_discardis incorrect, it will cause its upper filesystem breakdown.
Consider the following scenario:
on some architecture or config,PAGE_SIZEis 64K for example, filesystem is set up on zram disk withoutPAGE_SIZEaligned,
a discard bio leads to a offset = 4K and size=72K,
normally, it should not really discard any physical block as it partially cover two physical blocks.
However, with the current offset usage, it will discard the second physical block and free its memory, which will cause filesystem breakdown.Quoted 1 line
This patch corrects the offset usage in
zram_bio_discard.Nice catch.
Surely we need fix but I'd like to go further. Let's think. How do you find that? Real problem or code review?
I'd like to know how much that happens in real practice because if it's a lot, it means discard support is just an overhead without any benefit.If you just found it with code
review(ie, don't have any data), would you mind adding some stat like 'num_discard/failed_discard' so we can keep an eye on that. Although it's for rare case, I think it's worth. Because someone would do swapon zram with --discard,
it could make same problem due to early page freeing of zram-swap to avoid duplicating VM-owned memory and ZRAM-owned memory.We can guide to zram-swap user not to use swapon with --discard but I don't want it because
swap_slot_free_notifyis really mess which violates layering so I hope replace it with discard finally so such statistics really help us to drive that way more quickly.
Actually, I found this issue by code review not real practice. I agree with you that it is worthy of adding some stat on discard behavior, I will send a patch about it.
As to zram-swap, I think we could drop swap_slot_free_notify by using discard, there is no technical issue as swap_extent is aligned to PAGE_SIZE and we discard swap_cluster at a time.
However, what I worry about is that we can not force end-user to use --discard, if someone forget it(we can not expect every end-user understand the kernel mechanism),
he will not get the benefit of zram-swap and be confused.
So, is there any possibility that kernel do it transparently? May be we need modify
the swap subsystem to surpport different hierarchical swapfiles.
Thanks for your advice, I really admire your further thinking.
Quoted 43 lines
I second this. if we could drop
swap_slot_free_notifythat'd be nice.-ssQuoted 38 lines
Quoted 28 lines
Signed-off-by Weijie Yang <[email protected]>Acked-by Joonsoo Kim <[email protected]>--- drivers/block/zram/zram_drv.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)drivers/block/zram/zram_drv.c +2
-3@@ -572,10 +572,10 @@ static void zram_bio_discard(struct zram *zram, u32 index,* skipping this logical block is appropriate here. */ if (offset) { -if (n < offset) +if (n <= (PAGE_SIZE - offset))return ; - n -= offset; + n -= (PAGE_SIZE - offset); index++; } --1.7.10.4
Quoted 5 lines
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/--
Kind regards,
Minchan Kim