Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 41D57EB64DD for ; Tue, 4 Jul 2023 11:19:57 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C453A900011; Tue, 4 Jul 2023 07:19:56 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id BF51790000D; Tue, 4 Jul 2023 07:19:56 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id ABCE8900011; Tue, 4 Jul 2023 07:19:56 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 9A04990000D for ; Tue, 4 Jul 2023 07:19:56 -0400 (EDT) Received: from smtpin09.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 603AB1A0987 for ; Tue, 4 Jul 2023 11:19:56 +0000 (UTC) X-FDA: 80973684792.09.5649FA9 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf16.hostedemail.com (Postfix) with ESMTP id 8AC15180012 for ; Tue, 4 Jul 2023 11:19:54 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf16.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1688469594; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=izgafqnTvn2G0HTIlnGcEkIhUk0KT2WvtFRUWJDdnPQ=; b=ufJil3SOMteHAqH6DYb6Nh9X6iU+zhXue3rEHA9qMy99O+LJYyZiXZJWZrLy9g/x5Z3sTn mJ3FI5sWWYQpwgQvHfY8/ebmK7oPmqby1xmuF13//IcHc7pm9hpclbzFY5F18dOLtAB5KL QxwWAc/vdPE3z8wZORhbK+WqU7QDk30= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf16.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1688469594; a=rsa-sha256; cv=none; b=MlZqi0rPyByv3Um7iK11x8356ohWLYjlhMqXhsbs4QXETJSApW1kSgwk/41BlbA5ApbF7L 9OlW9aapE8iAZQgiCvdcrBwYmZ7kCQerrctJw9GfrhgEIaGeSzI9ASbfcbTaqT33JWccaw y/k+1bBfuuUby32Jrh2/1lKUvCpoAPk= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id EBCF22F4; Tue, 4 Jul 2023 04:20:35 -0700 (PDT) Received: from [10.1.35.40] (C02Z41KALVDN.cambridge.arm.com [10.1.35.40]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id EB4C63F73F; Tue, 4 Jul 2023 04:19:51 -0700 (PDT) Message-ID: <753fe3a7-e077-09d0-8233-fa834c11d280@arm.com> Date: Tue, 4 Jul 2023 12:19:50 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: [PATCH v2 1/5] mm: Non-pmd-mappable, large folios for folio_add_new_anon_rmap() To: "Yin, Fengwei" , Yu Zhao Cc: Andrew Morton , Matthew Wilcox , "Kirill A. Shutemov" , David Hildenbrand , Catalin Marinas , Will Deacon , Anshuman Khandual , Yang Shi , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org References: <20230703135330.1865927-1-ryan.roberts@arm.com> <20230703135330.1865927-2-ryan.roberts@arm.com> <9e2fe34e-7615-119c-43b3-31d0b8be3af0@intel.com> From: Ryan Roberts In-Reply-To: <9e2fe34e-7615-119c-43b3-31d0b8be3af0@intel.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 8AC15180012 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: mccumspx6s3wguhquhjukem18iehx8mx X-HE-Tag: 1688469594-173483 X-HE-Meta: U2FsdGVkX1+JguV/gHILhC40vtcUzHBBUcspGt5hCrCNqdOqXeYJGdlUx99LiY0IdHJsVko/lP2qUktJIZ/EYsPoeKwuclvMpnPg5dr0E2JPLcgeRS0HernyCGUCzkWu23jw+QklvJobG16lKoaW1O5W/wsMNkmEo1NFu8SwrAdNEtPq0pXf+SemTtTRKBv2XoDHL1mabsaq6WZnw7pLDHijrABXpt1CJ7k5fXrQd76ITUfozWuRzYfvnK8vqyAET04LLMnFVosK8DeXW0yR10flq60EWbKwCkdq2nh80c2GCSBNCNv69BCXDoEl29kWN20AIWVyYJj2sQ9pA1c1NnbOKuVKTaWQUdO0cizXTWcY4ZdEzL2Pj6n6PUmyuGQ/ETZfodaHbzRx5Qk6Lbqov26kMn43euTX7xA1PczQFD2Ebu53CGUJhgkiWcWtbWT4VxLud9qHAsva0833B/hwbeIb+TOqAr2aVGetDuVSMlEbOQM5XnNwDAyiOtlCLxnqqUNf6yzpdvhFZXvHLPPUeYAA9mS0RAoXMUsAKNbZmnFQCp+3FhutzNGQa+xovBUC1x/SmCOPfbedkJNzPI0a/JIG9pZAgTkkc95N5Tjg1ABGXklBq8WbF7SrxTfz3TtJb/tFDlXO38p+avTG6i11/x6iZV5h/EFq7ti3qg0hd35JHYN7IthWKxNony0nuHIB8jVWoP954zu7TTfydt8CM2HI218TayUdx0YKr3O7P/M133h8VoG1bw6vyT68EmQThLfiY34RkXIQMRYgObk1GNl2QNISxSrsDZaIkzMdCLWxEdKwT3uZqAuk3Xr5RwB/ukrC87pEUrhMg7KhHzNPpwacTIHknJwqJTg/tXNDTMEBAZwWuiBtU6+jPX6ff98RwlOuY/cSkZxpsl4xNodn2pbhCzBn9ATaCofNP7s09KXEFCFihiqC5FSXvSu2sxSFDscwZ2E3DSi5QFheKtk H4A3Hfov EDLGIfzmQkoJUdjMpaFcdGqh1jJMdTtMqpjxqiSK5QL8/Ir4vbMJQsbFl8FSld5zuB7cV8EUlmKF6phUM7AR5irFGiv61W7fzsB4LBa/5MDar7G4i/Ry6esLsmp6KJGHo5DhS6T8rWN5nyBXa9xyr9RHTp8lS4cibHcwoiRNB0v77xUdX4vCm378tXAPtU0J5avR0ah36+ov4lfsfUR/JEy5C0L1TpRZ4vqOHqCQNIPS9ehFrJ2f8WyGWhVl407CUH7vWxW1BTWm8Ehyg78pVuMhvq2TiJF4p+v8ZAKC60Ym6wBpxEW1urHERLPgs1Fb+h3cPNUqi/2MNGmCRu29NDmwoPOSjvuV4sejo/+IB3XqZuv0= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 04/07/2023 03:13, Yin, Fengwei wrote: > > > On 7/4/2023 3:05 AM, Yu Zhao wrote: >> On Mon, Jul 3, 2023 at 7:53 AM Ryan Roberts wrote: >>> >>> In preparation for FLEXIBLE_THP support, improve >>> folio_add_new_anon_rmap() to allow a non-pmd-mappable, large folio to be >>> passed to it. In this case, all contained pages are accounted using the >>> "small" pages scheme. >> >> Nit: In this case, all *subpages* are accounted using the *order-0 >> folio* (or base page) scheme. > Matthew suggested not to use subpage with folio. Using page with folio: > https://lore.kernel.org/linux-mm/Y9qiS%2FIxZOMx62t6@casper.infradead.org/ OK, I'll change this to "In this case, all contained pages are accounted using the *order-0 folio* (or base page) scheme." > >> >>> Signed-off-by: Ryan Roberts >> >> Reviewed-by: Yu Zhao Thanks! >> >>> mm/rmap.c | 26 +++++++++++++++++++------- >>> 1 file changed, 19 insertions(+), 7 deletions(-) >>> >>> diff --git a/mm/rmap.c b/mm/rmap.c >>> index 1d8369549424..82ef5ba363d1 100644 >>> --- a/mm/rmap.c >>> +++ b/mm/rmap.c >>> @@ -1278,31 +1278,43 @@ void page_add_anon_rmap(struct page *page, struct vm_area_struct *vma, >>> * This means the inc-and-test can be bypassed. >>> * The folio does not have to be locked. >>> * >>> - * If the folio is large, it is accounted as a THP. As the folio >>> + * If the folio is pmd-mappable, it is accounted as a THP. As the folio >>> * is new, it's assumed to be mapped exclusively by a single process. >>> */ >>> void folio_add_new_anon_rmap(struct folio *folio, struct vm_area_struct *vma, >>> unsigned long address) >>> { >>> - int nr; >>> + int nr = folio_nr_pages(folio); >>> + int i; >>> + struct page *page; >>> >>> - VM_BUG_ON_VMA(address < vma->vm_start || address >= vma->vm_end, vma); >>> + VM_BUG_ON_VMA(address < vma->vm_start || >>> + address + (nr << PAGE_SHIFT) > vma->vm_end, vma); >>> __folio_set_swapbacked(folio); >>> >>> - if (likely(!folio_test_pmd_mappable(folio))) { >>> + if (!folio_test_large(folio)) { >>> /* increment count (starts at -1) */ >>> atomic_set(&folio->_mapcount, 0); >>> - nr = 1; >>> + __page_set_anon_rmap(folio, &folio->page, vma, address, 1); >>> + } else if (!folio_test_pmd_mappable(folio)) { >>> + /* increment count (starts at 0) */ >>> + atomic_set(&folio->_nr_pages_mapped, nr); >>> + >>> + page = &folio->page; >>> + for (i = 0; i < nr; i++, page++, address += PAGE_SIZE) { >>> + /* increment count (starts at -1) */ >>> + atomic_set(&page->_mapcount, 0); >>> + __page_set_anon_rmap(folio, page, vma, address, 1); >>> + } >> >> Nit: use folio_page(), e.g., Yep, will change for v3. >> >> } else if (!folio_test_pmd_mappable(folio)) { >> int i; >> >> for (i = 0; i < nr; i++) { >> struct page *page = folio_page(folio, i); >> >> /* increment count (starts at -1) */ >> atomic_set(&page->_mapcount, 0); >> __page_set_anon_rmap(folio, page, vma, address + PAGE_SIZE * i, 1); >> } >> /* increment count (starts at 0) */ >> atomic_set(&folio->_nr_pages_mapped, nr); >> } else { >> >>> } else { >>> /* increment count (starts at -1) */ >>> atomic_set(&folio->_entire_mapcount, 0); >>> atomic_set(&folio->_nr_pages_mapped, COMPOUND_MAPPED); >>> - nr = folio_nr_pages(folio); >>> __lruvec_stat_mod_folio(folio, NR_ANON_THPS, nr); >>> + __page_set_anon_rmap(folio, &folio->page, vma, address, 1); >>> } >>> >>> __lruvec_stat_mod_folio(folio, NR_ANON_MAPPED, nr); >>> - __page_set_anon_rmap(folio, &folio->page, vma, address, 1); >>> }