Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CB6F3C433DF for ; Tue, 14 Jul 2020 08:58:55 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9C5E720BED for ; Tue, 14 Jul 2020 08:58:55 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=ffwll.ch header.i=@ffwll.ch header.b="VEo69UZb" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9C5E720BED Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=ffwll.ch Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=amd-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 5F5466E40D; Tue, 14 Jul 2020 08:58:55 +0000 (UTC) Received: from mail-wr1-x442.google.com (mail-wr1-x442.google.com [IPv6:2a00:1450:4864:20::442]) by gabe.freedesktop.org (Postfix) with ESMTPS id D397B6E40D for ; Tue, 14 Jul 2020 08:58:53 +0000 (UTC) Received: by mail-wr1-x442.google.com with SMTP id q5so20361323wru.6 for ; Tue, 14 Jul 2020 01:58:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=Xq+neimvk6HZT/Q39GtRWstkNYMMYBAY0Yje4sEgb/o=; b=VEo69UZb6oB/l6X5WEkHrMRDt7+pCnG1kOU0RDFn4tjSacottUkDf5TysuGbg6A5da niVAWRNrytgcuBI/EToRyOePBau6silQceyMecr8YxTZYrJ8VNw/QQq2b8aLWFlN89LT fARN0hBwTe7ugGPUrswWUx5MC3VHKNhMMIz3k= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=Xq+neimvk6HZT/Q39GtRWstkNYMMYBAY0Yje4sEgb/o=; b=K4R+4aROar82Ky9SGUmz+hpqz37XA2h5LvD4KTu07wny1ios3Ue3blQYjKZX4Hhirm 6C6RsWp6WiWem3q/LhAWQH/IDlNWNkh/VShpniinv3nwkBe99rTjQmmOZzPofpcTto10 cqE4kwLHybk2s+72QN347NSew+uuAXAAEGjkJVhwGXIbxCy8cyBinJEjYL8b1Z8gifjW bYWleMRJhGTEqYmoohZnxsh1ovKjcRLRnioRUMUDX0zKD8I83tt0qtDk5bUmLLdnPdAo vuLAdgavGvlG6bKn5Mue9SvzJx4rArPhzSXPp4EXIm3e+vIYkhDG5Lbo1HJEXcS+B6oQ 31Vw== X-Gm-Message-State: AOAM531AasZd/To7b80CvYcEe9VC7Vn3TQQvnivyR3YGW50X3TemSbp5 PA6I7iI08jIezElVpclZ/ezYXg== X-Google-Smtp-Source: ABdhPJw8lYMC2gHSLTj5xV/HaZdpcbhLSpLKp16iVNCddAtDak+dkjo983BIbrAowVMQvqI9LS8/RA== X-Received: by 2002:a05:6000:1cf:: with SMTP id t15mr4223119wrx.180.1594717132475; Tue, 14 Jul 2020 01:58:52 -0700 (PDT) Received: from phenom.ffwll.local ([2a02:168:57f4:0:efd0:b9e5:5ae6:c2fa]) by smtp.gmail.com with ESMTPSA id s15sm3282618wmj.41.2020.07.14.01.58.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 14 Jul 2020 01:58:51 -0700 (PDT) Date: Tue, 14 Jul 2020 10:58:50 +0200 From: Daniel Vetter To: Dave Airlie Subject: Re: [PATCH 1/1] drm/amdkfd: Add IPC API Message-ID: <20200714085850.GX3278063@phenom.ffwll.local> References: <20200714031435.13362-1-Felix.Kuehling@amd.com> <20200714031435.13362-2-Felix.Kuehling@amd.com> <4245d340-f4f6-eeb5-40a6-3afd7754852c@amd.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-Operating-System: Linux phenom 5.6.0-1-amd64 X-BeenThere: amd-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion list for AMD gfx List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "Deucher, Alexander" , Daniel Vetter , Felix Kuehling , amd-gfx mailing list , dri-devel Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: amd-gfx-bounces@lists.freedesktop.org Sender: "amd-gfx" On Tue, Jul 14, 2020 at 02:26:36PM +1000, Dave Airlie wrote: > On Tue, 14 Jul 2020 at 14:09, Felix Kuehling wrote: > > > > Am 2020-07-13 um 11:28 p.m. schrieb Dave Airlie: > > > On Tue, 14 Jul 2020 at 13:14, Felix Kuehling wrote: > > >> This allows exporting and importing buffers. The API generates handles > > >> that can be used with the HIP IPC API, i.e. big numbers rather than > > >> file descriptors. > > > First up why? I get the how. > > > > The "why" is compatibility with HIP code ported from CUDA. The > > equivalent CUDA IPC API works with handles that can be communicated > > through e.g. a pipe or shared memory. You can't do that with file > > descriptors. > > Okay that sort of useful information should definitely be in the patch > description. > > > > > https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__DEVICE.html#group__CUDART__DEVICE_1g8a37f7dfafaca652391d0758b3667539 > > > > https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__DEVICE.html#group__CUDART__DEVICE_1g01050a29fefde385b1042081ada4cde9 > > > > > > > >> + * @share_handle is a 128 bit random number generated with > > >> + * @get_random_bytes. This number should be very hard to guess. > > >> + * Knowledge of the @share_handle implies authorization to access > > >> + * the shared memory. User mode should treat it like a secret key. > > >> + * It can be used to import this BO in a different process context > > >> + * for IPC buffer sharing. The handle will be valid as long as the > > >> + * underlying BO exists. If the same BO is exported multiple times, > > > Do we have any examples of any APIs in the kernel that operate like > > > this? That don't at least layer some sort of file permissions and > > > access control on top? > > > > SystemV shared memory APIs (shmget, shmat) work similarly. There are > > some permissions that can be specified by the exporter in shmget. > > However, the handles are just numbers and much easier to guess (they are > > 32-bit integers). The most restrictive permissions would allow only the > > exporting UID to attach to the shared memory segment. > > > > I think DRM flink works similarly as well, with a global name IDR used > > for looking up GEM objects using global object names. > > flink is why I asked, because flink was a mistake and not one I'd care > to make again. > shm is horrible also, but at least has some permissions on what users > can attack it. Yeah this smells way too much like flink. I had the same reaction, and kinda sad that we have to do this because nvidia defines how this works with 0 input from anyone else. Oh well, the world sucks. > > > The reason fd's are good is that combined with unix sockets, you can't > > > sniff it, you can't ptrace a process and find it, you can't write it > > > out in a coredump and have someone access it later. > > > > Arguably ptrace and core dumps give you access to all the memory > > contents already. So you don't need the shared memory handle to access > > memory in that case. > > core dumps might not dump this memory though, but yeah ptrace would > likely already mean you have access. > > > > Maybe someone who knows security can ack merging this sort of uAPI > > > design, I'm not confident in what it's doing is in any ways a good > > > idea. I might have to ask some people to take a closer look. > > > > Please do. We have tried to make this API as secure as possible within > > the constraints of the user mode API we needed to implement. > > I'll see if I hear back, but also if danvet has any input like I > suppose it's UUID based buffer access, so maybe 128-bit is enough and > you have enough entropy not to create anything insanely predictable. So one idea that crossed my mind is if we don't want to do this as a generic dma-buf handle converter. Something like /dev/dri/cuda_is_nasty (maybe slightly nicer name) which provides a generic dma-buf <-> cuda uuid converter. With separate access restrictions, so admins can decide whether they want to allow this silliness, or not. Anyone else who wants to reimplement cuda will need this too, so that's another reason for splitting this out. Wrt security: I think assuming that there's none and the lookup has a side-channel you can use to efficiently scan the entire range is probably the safe approach here. This is way out of my league, but I think people who know how to do this won't have a much harder time scanning this than the flink space. Also, if we have one common uuid->dma-buf converter, we might actually have a chance to proof the "it's not secure" assumption wrong. Also, we might be able to tie this into cgroups or namespaces or similar that way. Just some thoughts to give my initial "eek, why this" reaction a bit more substance :-) No idea whether this would work or make more sense. Cheers, Daniel -- Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch _______________________________________________ amd-gfx mailing list amd-gfx@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/amd-gfx