Skip to content

patches to improve cluster raid1 performance [V2]

dongmao zhang dm-devel 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest2 patches 7 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/2improve the performance of dm-log-userspacedrivers/md/dm-log-userspace-base.c+60 -50 replies
2/2change API of dm-log-userspace to support delay flushdrivers/md/dm-log-userspace-base.c include/uapi/linux/dm-log-userspace.h+59 -230 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 0/2] patches to improve cluster raid1 performance [V2]

This patch change DM_ULOG_REQUEST_VERSION from 2 to 3. It could tell cmirrord that kernel is now supporting delay some flushes, and cmirrord will do someting accordingly.

Based on my test result, the cluster raid1 writes loss 80% performance. I found that the most time is occupied by the function userspace_flush.

Usually userspace_flush needs three stages(mark, clear, flush)to communicate with cmirrord.

From the cmirrord's perspective, mark and flush functions run cluster_send first and then return to the kernel.

In other words, the requests of mark_region and flush in userspace_flush at least require a cluster_send period to finish. this is the root cause of bad performance.

The idea is to merge flush and mark request together in both cmirrord and dm-log-userspace.

We run clog_flush directly after clog_mark_region. So the userspace_flush do not have to request flush again after requesting mark_region. Moreover, I think the flush of clear region could be delayed. If we have both mark and clear region, only sending a mark_region request is OK, because clog_flush will automatically run.(ignore the clean_region time). It only takes one cluster_send period. If we have only mark region,
a mark_region request is also OK, it takes one cluster_send period. If we have only clear_region, we could delay the flush of cleared_region for 3 seconds.

Overall, before the patch, mark_region require approximately two cluster_send period(mark_region and flush), after the patch, mark_region only needs one cluster_send period. Based on my test, the performance is as twice as before.

dongmao zhang (2):
improve the performance of dm-log-userspace change API of dm-log-userspace to support delay flush

 drivers/md/dm-log-userspace-base.c    |  109 ++++++++++++++++++++++++++++++---
 include/uapi/linux/dm-log-userspace.h |    2 +-
 2 files changed, 101 insertions(+), 10 deletions(-)
Signature · 1 line
1.7.3.4