Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 00599C43381 for ; Wed, 20 Feb 2019 14:24:20 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id C434C20880 for ; Wed, 20 Feb 2019 14:24:19 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=plexistor-com.20150623.gappssmtp.com header.i=@plexistor-com.20150623.gappssmtp.com header.b="hX9QLH0C" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726604AbfBTOYT (ORCPT ); Wed, 20 Feb 2019 09:24:19 -0500 Received: from mail-wr1-f66.google.com ([209.85.221.66]:39245 "EHLO mail-wr1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726030AbfBTOYS (ORCPT ); Wed, 20 Feb 2019 09:24:18 -0500 Received: by mail-wr1-f66.google.com with SMTP id l5so25094846wrw.6 for ; Wed, 20 Feb 2019 06:24:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=plexistor-com.20150623.gappssmtp.com; s=20150623; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=6hz4CIWJA7sYkt5EBfLIo+VDjAsy0V0Sh/5WX32bJVQ=; b=hX9QLH0CnMOAGzqoLa4y+C5zUhvGDV9XeZqxyQi9LPtj2PN5ni+slrgRlz6sRt1YDW VWDPbq4AGjsKgRhsEpzAvNkpHkxEA7o1Lc+Yef9cq+KuuU7Rn+X9Ghpry4mZSa6Ew2da X67tw4D23dY9dSEaByW+rtfO5c/vR5Z35ROduAK0lsyOQGUjpd0brKR5ERJAGQFa9yhN tL3zlDL/F4IIIb6R+aiapUuquI+tAtXxs/16Q/LNQygsoHNrCCQfIN19iUlXxnItRTIg xt9Ro8h6kTFD5QimIJu+vU2E0QaZziFLYxQSB0TrO9Oi0usfgKSt7qz0dJXLec8W8+xc S8Ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=6hz4CIWJA7sYkt5EBfLIo+VDjAsy0V0Sh/5WX32bJVQ=; b=HcNEyUACDU0f67wdd4wPllBYemtlYaO4AkVTuZySGFw/KjQMRJY8RvGMnXLd6QbevU KuykC0Sz1RPV6PCCus4FwfBLxzhpPOUVI4qxSes0hhi8XymaiBlJXz4VMAzOfpY9zuHv BYvy4SmDVe74sQzpNqlgjEx7XQGgt+4gcQWFmcXr+FL3bULhp4MeOVMI8PAuz328As6q FbVJ5FHdzkqkmVemySpgmKmGzix/yLQEzrvmaUoT6hb/cjhMVoNzvBHKTnVqwf2esJyz rBJ1/F+Ryx0RD41b6Wawe6SZhaxzhcVZlhaN27D7BZKVL5CTUkyjQST2g5DBv3GapQn7 jKuw== X-Gm-Message-State: AHQUAuakcKog1IOpl1utR5zbFF1rwzLsZvNkZTvC+x9CJRHx303uuZtx BC2l7dGZvB/6WHvqjHwk/f9pzA== X-Google-Smtp-Source: AHgI3IboYoFsOOPRmnCgtGVTYHJcVS97NdTJjCmgcRX376onDUA+8vvKvFcKGBtVliVQ24QcMGVm4w== X-Received: by 2002:adf:fdcd:: with SMTP id i13mr6000576wrs.212.1550672652378; Wed, 20 Feb 2019 06:24:12 -0800 (PST) Received: from [10.0.0.5] ([207.232.55.62]) by smtp.googlemail.com with ESMTPSA id s127sm6984098wmf.39.2019.02.20.06.24.10 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 20 Feb 2019 06:24:11 -0800 (PST) Subject: Re: [RFC PATCH 02/17] zuf: Preliminary Documentation To: Miklos Szeredi References: <20190219115136.29952-1-boaz@plexistor.com> <20190219115136.29952-3-boaz@plexistor.com> Cc: linux-fsdevel , Anna Schumaker , Al Viro , Ric Wheeler , Steven Whitehouse , Jefff moyer , Amir Goldstein , Amit Golander , Sagi Manole From: Boaz Harrosh Message-ID: Date: Wed, 20 Feb 2019 16:24:09 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Sender: linux-fsdevel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org On 20/02/19 10:27, Miklos Szeredi wrote: > On Tue, Feb 19, 2019 at 12:51 PM Boaz harrosh wrote: >> > >> +4. An FS operation like create or WRITE/READ and so on arrives from application >> + via VFS. Eventually an Operation is dispatched to zus: >> + ▪ A special per-operation descriptor is filled up with all parameters. >> + ▪ A current CPU channel is grabbed. the operation descriptor is put on >> + that channel (ZT). Including get_user_pages or Kernel-pages associated >> + with this OPT. >> + ▪ The ZT is awaken, app thread put to sleep. >> + ▪ In ZT context pages are mapped to that ZT-vma. This is so we are sure >> + the map is only on a single core. And no other core's TLB is affected. >> + (This here is the all performance secret) > > I still don't get it. You say mapping the page to server address > space is the performance secret. I say it's a security issue as well > as being perfectly useless, except for special cases. > Already working on this. Will submit new code in a month. There is already an API of GET_BLOCK that returns one or more server blocks (vi dpp_t) to Kernel. Today it is used in mmap, to directly map pmem to application space. We will use this API to memcpy(nt) in kernel space. The mapping facility will be optional for zusFS(s) but the preferred way will be Kernel side copy. This is because vm_zap_ptes() is way way to slow in current design and I need things faster ... <> > Thanks, > Miklos > Thanks Boaz