Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id EB623C77B72 for ; Fri, 14 Apr 2023 14:24:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8E82D900002; Fri, 14 Apr 2023 10:24:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 8987C6B0078; Fri, 14 Apr 2023 10:24:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 71219900002; Fri, 14 Apr 2023 10:24:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 61E736B0075 for ; Fri, 14 Apr 2023 10:24:42 -0400 (EDT) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 333C8A02B9 for ; Fri, 14 Apr 2023 14:24:42 +0000 (UTC) X-FDA: 80680217604.10.B6E7AD3 Received: from mail-pl1-f173.google.com (mail-pl1-f173.google.com [209.85.214.173]) by imf06.hostedemail.com (Postfix) with ESMTP id 3C3B3180012 for ; Fri, 14 Apr 2023 14:24:40 +0000 (UTC) Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=BixafL2X; spf=pass (imf06.hostedemail.com: domain of shiyn.lin@gmail.com designates 209.85.214.173 as permitted sender) smtp.mailfrom=shiyn.lin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681482280; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=EI/xgA3T+jD6+X1P1tFB/fdrO9EhnI4pOgRfKhyKXi8=; b=WCHRBb0wm0ffcrvKozVafB9spkmBzhJISTYqG2xjQkGJ6HFbrgiFhvMbacByPhwzJ3Q/AN LURvZ3cglnGVFjzDsydGvxtqw+s1bA05EV0rV4HWV+oYTuv4Bi3lAjI0Ph/IoHYoYwd9tB UPWMsfeP8cqnm+SnDMn2+JUvaWlTqJA= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=BixafL2X; spf=pass (imf06.hostedemail.com: domain of shiyn.lin@gmail.com designates 209.85.214.173 as permitted sender) smtp.mailfrom=shiyn.lin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681482280; a=rsa-sha256; cv=none; b=KYx71IxDCOqI6ygmTLoxdjqNx+Vd25xoGKgh6Nj9Fda6yc3q0GqZKne0OEksMnNoJl5C5m kl3ShCA7/7OfGrhYlcuZ7T7wjGxtbCjO1vdkef98Pan7KdFjUHiEAPtWBvjy+vf9hoqEkW hVpCcC7jqqeiMHIv7GKJ5Pm3s/dUxiQ= Received: by mail-pl1-f173.google.com with SMTP id y6so17353541plp.2 for ; Fri, 14 Apr 2023 07:24:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1681482279; x=1684074279; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=EI/xgA3T+jD6+X1P1tFB/fdrO9EhnI4pOgRfKhyKXi8=; b=BixafL2X4wcWoWtGbcp1i0A44mxljV8uOcivnqO27ToE5AX2ZuNaK4G/cu8Lcd7WPW PTkS4iqrA1pfrRLh+IOGgVijQysN0IlC1ElrqSI9uI+FBFBERB/Ieah67xL75whmbVAt ltT47gvIbmjNK6zZF6p4vEem6LBPbEd2RZVyArcvt1+yUtsOfTu+fb01PE8JL97xAdmy 72d/eSP1iZl+hBEjB1TSm9ZNCdbGzVjjl4JXkDUQwC6KEIB/vcyrXKfHDeRRT4RV/Nuy E8raN5e8UN/g2lFwX53qw2DxMgl1Nd/8b1yZcMSviVRV5kzT+KQJfHFFZZgm/za9tQvg /JTQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681482279; x=1684074279; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=EI/xgA3T+jD6+X1P1tFB/fdrO9EhnI4pOgRfKhyKXi8=; b=Xn8JIKB5yNEeQnD05NIBLkDBFmlcN4eJk9eyFW9uj35VgTuDGryoHim/liUs6odY+Y n4yjuAb7LY7tAUa7cUpVq4dRPGo+YIKrH7JTvEySoGzN4orj+PH+J+8Ta7Pju5gcBlf6 Hu7S/EaR0UnLpbC+2noJvz0Hb+Rai0ZewvEzMxYBuguv4CYlkkw46GXn0Uxw+YFavlw4 l6CfT+C/SHWs0oQQAR8kqFUrTc00cUjob2tbzLKGjIUEyLWMCcxNfsRDCHt/2rHybOjL arvmznyCF2PD0OkGPdmUL13WcIgWmiAzrruhnYVytbODvnt23OmUTdoeqbPxnkZFDYxK 0TIA== X-Gm-Message-State: AAQBX9eSAYfyVcFszIN/nGgEhbGvMmDoExHAfaqamqFHywUvBXO1RKQT zBXAavwY9KOiRR073I3aDYM= X-Google-Smtp-Source: AKy350bVGay/l+iKywICpX6DkfyRQb5ITLNSdlflzo3Pxj01rUABeJIlD5c4oSXbLyfahy3pI5Uy8Q== X-Received: by 2002:a17:90a:fc6:b0:237:97a3:1479 with SMTP id 64-20020a17090a0fc600b0023797a31479mr6207174pjz.28.1681482279586; Fri, 14 Apr 2023 07:24:39 -0700 (PDT) Received: from strix-laptop.. (2001-b011-20e0-1499-8303-7502-d3d7-e13b.dynamic-ip6.hinet.net. [2001:b011:20e0:1499:8303:7502:d3d7:e13b]) by smtp.googlemail.com with ESMTPSA id h7-20020a17090ac38700b0022335f1dae2sm2952386pjt.22.2023.04.14.07.24.30 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 14 Apr 2023 07:24:39 -0700 (PDT) From: Chih-En Lin To: Andrew Morton , Qi Zheng , David Hildenbrand , "Matthew Wilcox (Oracle)" , Christophe Leroy , John Hubbard , Nadav Amit , Barry Song , Pasha Tatashin Cc: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , "H. Peter Anvin" , Steven Rostedt , Masami Hiramatsu , Peter Zijlstra , Arnaldo Carvalho de Melo , Mark Rutland , Alexander Shishkin , Jiri Olsa , Namhyung Kim , Ian Rogers , Adrian Hunter , Yu Zhao , Steven Barrett , Juergen Gross , Peter Xu , Kefeng Wang , Tong Tiangen , Christoph Hellwig , "Liam R. Howlett" , Yang Shi , Vlastimil Babka , Alex Sierra , Vincent Whitchurch , Anshuman Khandual , Li kunyu , Liu Shixin , Hugh Dickins , Minchan Kim , Joey Gouly , Chih-En Lin , Michal Hocko , Suren Baghdasaryan , "Zach O'Keefe" , Gautam Menghani , Catalin Marinas , Mark Brown , "Eric W. Biederman" , Andrei Vagin , Shakeel Butt , Daniel Bristot de Oliveira , "Jason A. Donenfeld" , Greg Kroah-Hartman , Alexey Gladkov , x86@kernel.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-trace-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, Dinglan Peng , Pedro Fonseca , Jim Huang , Huichun Feng Subject: [PATCH v5 02/17] mm: Allow user to control COW PTE via prctl Date: Fri, 14 Apr 2023 22:23:26 +0800 Message-Id: <20230414142341.354556-3-shiyn.lin@gmail.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20230414142341.354556-1-shiyn.lin@gmail.com> References: <20230414142341.354556-1-shiyn.lin@gmail.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Stat-Signature: 9eoxa36zh7i6y8mo1p31x7hokdnqczd6 X-Rspam-User: X-Rspamd-Queue-Id: 3C3B3180012 X-Rspamd-Server: rspam06 X-HE-Tag: 1681482280-974400 X-HE-Meta: U2FsdGVkX18opHsuEfh/+DOKr+Ef+v4XbahqP425evHvqc8pkJhVcaTCVs3EnVXX2tBVD0lMgF51nMrU2I1St7D9URyAlP0g0Qnf0bIDw7PJRoa86lXg/xpWw2ZmRUxHkpVUW93bnu1hErjFZCKZuu3SOvNctcxQDTFTiv5VblcUr0XDtj67fimVlUH/uE0uBmr47P11MRV5KqiU+W5UqitvB/mDfl2tIj+fv8mr2R8ZKOcX9+vl55gwT6Ww/GFKFUKYQrd4bhXjoMnn/kvjSZhRwVpodK+cfFgSgdtE6EmctkoS3TUI0uIhj0zWG6TmJIUuyV1L6PtQoVbdsFx4EDKcJbk/5AhokHspQmguGTZ5IzAQJ122Qn6ZAk6ijNTIOuY/XvMIHO9oijK8pSBZ1bUb/lzJIpePIHX2o/d0bjzWQypMMq5XRr72bME1z6xmJTFSRj5HgXlJx1Ch/aZcxGcsLpXej+f5vghh2su9Q0bJJ+MWVBKwjvLBWaE8Eb3YTeaEo3qqaa/xH6qOYGMdNfiE6yUynbyzMjEeO8REewN4AVAVV+6JOT5Io3w8+xnHaXLFlXyHgAHJRZ6ns1l3qirPhwT7kF1YnFnb0iJhrjd9HxOwHlsUUHVpJESg3gQqr8LTtNOROxKbF2xzWKiOWnk0fCWZuVXoz1v0WGAAR1XUXZy6G74ARboyjWHK3oIhbLu2e/1ZasGHpF5flBOXUL7CjgYbpujoDnbkOK2hDqKvNIAAC7KEiEKoIKsi0BA9VUS9lnBKNuPyiledneIcwnhyMgYa23oLB0o0O7eYCPQruOxZhg45Swhjps4Qd2s6b6UihNdfIFozhoMtlY7ER02oPwSZ1A4WStB2U9PNtjIn4UK7BhltcY0Qs4+c1I9RGF/wWUGaGp9Iju+adgTQ3XQl6YcdwKlwHaszlIxd9b8PRqwGGJGWT+iKfhJQqFo1QX9Bynr4bt2/aq33CMS jX5sTwHS 4EPT7N5KB4qV6FQ/43HSsamq6tWYv66pojRp5PxWPy/VSQzSFDC8pcRtiuXRGOcEFHzzBviPXxms+/dYwzGqVVPOgptdHD8+EFKVvDp67zPFc0K/pveWiB1uQTg9qJGaDHsTk17LQmCeoCDFe8JcLIAevdtFKiGONrnVuQyXUuzfowOAEXOFzhX+xle4IGA+1HEW+07cwYGSCqwJxTU7rnSZ23uomYz2a6Nf42KCchBMpoYc1JCAG3ZzajI2si4MFHixoH7itLf4RasChVAM8b2RkwnAA/az3Uk7XmHNBWmD/q1mQGPEUzosucUYxBRig5mV8Pe6ituxkbspc5mvAWm35lbTQCk3ggmAO/dkrsWFI57cKPjar112bGFLpmvDH/nrxL7RHwN7EpoZfAua0I7cBdYfqaUGaa2+JnPQRb/bXlsjax5R7nCsHCGgmMDLAzdV8KUa4bhT8nJ2ZyJLujExxnWVdXZsx/OiHIA4QuV8lcZYEhPkZYOeJL5Lzw/G91rgXkn+XJIGYcJ2isHdUJ67K8bbbrR1AICaJhJiiBIEwt10= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Add a new prctl, PR_SET_COW_PTE, to allow the user to enable COW PTE. Since it has a time gap between using the prctl to enable the COW PTE and doing the fork, we use two states (MMF_COW_PTE_READY and MMF_COW_PTE) to determine the task that wants to do COW PTE or already doing it. The MMF_COW_PTE_READY flag marks the task to do COW PTE in the next time of fork(). During fork(), if MMF_COW_PTE_READY set, fork() will unset the flag and set the MMF_COW_PTE flag. After that, fork() might shares PTEs instead of duplicates it. Signed-off-by: Chih-En Lin --- include/linux/sched/coredump.h | 13 ++++++++++++- include/uapi/linux/prctl.h | 6 ++++++ kernel/sys.c | 11 +++++++++++ 3 files changed, 29 insertions(+), 1 deletion(-) diff --git a/include/linux/sched/coredump.h b/include/linux/sched/coredump.h index 0e17ae7fbfd3..dff4b0938c39 100644 --- a/include/linux/sched/coredump.h +++ b/include/linux/sched/coredump.h @@ -87,7 +87,18 @@ static inline int get_dumpable(struct mm_struct *mm) #define MMF_DISABLE_THP_MASK (1 << MMF_DISABLE_THP) +/* + * MMF_COW_PTE_READY: Marking the task to do COW PTE in the next time of + * fork(). During fork(), if MMF_COW_PTE_READY set, fork() will unset the + * flag and set the MMF_COW_PTE flag. After that, fork() might shares PTEs + * rather than duplicates it. + */ +#define MMF_COW_PTE_READY 29 /* Share PTE tables in next time of fork() */ +#define MMF_COW_PTE 30 /* PTE tables are shared between processes */ +#define MMF_COW_PTE_MASK (1 << MMF_COW_PTE) + #define MMF_INIT_MASK (MMF_DUMPABLE_MASK | MMF_DUMP_FILTER_MASK |\ - MMF_DISABLE_THP_MASK | MMF_HAS_MDWE_MASK) + MMF_DISABLE_THP_MASK | MMF_HAS_MDWE_MASK |\ + MMF_COW_PTE_MASK) #endif /* _LINUX_SCHED_COREDUMP_H */ diff --git a/include/uapi/linux/prctl.h b/include/uapi/linux/prctl.h index 1312a137f7fb..8fc82ced80b5 100644 --- a/include/uapi/linux/prctl.h +++ b/include/uapi/linux/prctl.h @@ -290,4 +290,10 @@ struct prctl_mm_map { #define PR_SET_VMA 0x53564d41 # define PR_SET_VMA_ANON_NAME 0 +/* + * Set the prepare flag, MMF_COW_PTE_READY, to do the share (copy-on-write) + * page table in the next time of fork. + */ +#define PR_SET_COW_PTE 65 + #endif /* _LINUX_PRCTL_H */ diff --git a/kernel/sys.c b/kernel/sys.c index 495cd87d9bf4..eb1c38c4bad2 100644 --- a/kernel/sys.c +++ b/kernel/sys.c @@ -2377,6 +2377,14 @@ static inline int prctl_get_mdwe(unsigned long arg2, unsigned long arg3, PR_MDWE_REFUSE_EXEC_GAIN : 0; } +static int prctl_set_cow_pte(struct mm_struct *mm) +{ + if (test_bit(MMF_COW_PTE, &mm->flags)) + return -EINVAL; + set_bit(MMF_COW_PTE_READY, &mm->flags); + return 0; +} + SYSCALL_DEFINE5(prctl, int, option, unsigned long, arg2, unsigned long, arg3, unsigned long, arg4, unsigned long, arg5) { @@ -2661,6 +2669,9 @@ SYSCALL_DEFINE5(prctl, int, option, unsigned long, arg2, unsigned long, arg3, case PR_SET_VMA: error = prctl_set_vma(arg2, arg3, arg4, arg5); break; + case PR_SET_COW_PTE: + error = prctl_set_cow_pte(me->mm); + break; default: error = -EINVAL; break; -- 2.34.1