Skip to content

Add UALink instrastructure series 1

Alex Deucher amd-gfx 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest95 patches 1 replyIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/95drm/amdgpu: Add psp ualink command interfacesdrivers/gpu/drm/amd/amdgpu/psp_gfx_if.h+126 -00 replies
2/95drm/amdgpu: Fetch asp ualink interface versiondrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+26 -00 replies
3/95drm/amdgpu: Add sysfs API for UALink informationdrivers/gpu/drm/amd/amdgpu/Makefile drivers/gpu/drm/amd/amdgpu/amdgpu.h drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c +2 more+338 -00 replies
4/95drm/amdgpu: Add sysfs API for UALink physical pod setupdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+212 -00 replies
5/95drm/amdgpu: Add sysfs API for UALink virtual pod configdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+397 -00 replies
6/95drm/amdgpu: Add sysfs API for UALink station configurationdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+160 -00 replies
7/95drm/amdgpu: Add UALink manager core infrastructuredrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+81 -20 replies
8/95drm/amdgpu: Implement PSP cmd UAL_GET_CONFIGdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+64 -00 replies
9/95drm/amdgpu: Query initial UALink config from PSPdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h drivers/gpu/drm/amd/amdgpu/soc_v1_0.c+38 -00 replies
10/95drm/amdgpu: Implement PSP cmd UAL_SET_PPOD_CONFIGdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+49 -00 replies
11/95drm/amdgpu: Set physical pod configuration to PSPdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+8 -20 replies
12/95drm/amdgpu: Implement PSP cmd UAL_SET_VPOD_CONFIGdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+46 -00 replies
13/95drm/amdgpu: Set virtual pod configuration to PSPdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+8 -40 replies
14/95drm/amdgpu: Implement PSP cmd UAL_SET_STATION_CONFIGdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+39 -00 replies
15/95drm/amdgpu: Set UALink station config to PSPdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+7 -30 replies
16/95drm/amdgpu: Implement PSP cmd UAL_SET_NPA_CONFIGdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+33 -00 replies
17/95drm/amdgpu: Enable/disable NPA address translation using PSPdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+11 -10 replies
18/95drm/amdgpu: Add helper function to check psp xgmi tadrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+9 -30 replies
19/95drm/amdgpu: add handler for nHT errordrivers/gpu/drm/amd/amdgpu/amdgpu_gfx.h drivers/gpu/drm/amd/amdgpu/gfx_v12_1.c+45 -00 replies
20/95drm/amdgpu: Add ual_config_state to ual_get_configdrivers/gpu/drm/amd/amdgpu/psp_gfx_if.h+12 -00 replies
21/95drm/amdgpu: extend PSP command polling sleep rangedrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c+1 -10 replies
22/95drm/amdgpu: Fix NULL pointer issue during ualink initdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+11 -00 replies
23/95drm/amdgpu: Add a new NPA Address spacedrivers/gpu/drm/amd/amdgpu/amdgpu_object.c drivers/gpu/drm/amd/amdgpu/amdgpu_object.h drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +5 more+45 -30 replies
24/95drm/amdgpu: Add address allocator for NPA addressesdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+96 -00 replies
25/95drm/amdgpu: Initialize VM for NPA addr managementdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+20 -10 replies
26/95drm/amdgpu: Rework VMID reservation logicdrivers/gpu/drm/amd/amdgpu/amdgpu_ids.c drivers/gpu/drm/amd/amdgpu/amdgpu_ids.h drivers/gpu/drm/amd/amdgpu/gfx_v10_0.c +14 more+95 -280 replies
27/95drm/amdgpu: Reserve VMID for NPA VMdrivers/gpu/drm/amd/amdgpu/amdgpu_vm.h drivers/gpu/drm/amd/amdgpu/gmc_v12_0.c+17 -60 replies
28/95drm/amdgpu: Use reserved VMID for NPA VMdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+9 -40 replies
29/95drm/amdgpu: Enable UALink Manager when pod becomes activedrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+14 -20 replies
30/95drm/amdgpu: Fix UALink vPod double-activationdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+13 -00 replies
31/95drm/amdgpu: Add UALink remote state structures and API declarationsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+152 -00 replies
32/95drm/amdgpu: Add UALink NPA address layout helpersdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+101 -00 replies
33/95drm/amdgpu: Add UALink NPA address computation for ring buffersdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+97 -00 replies
34/95drm/amdgpu: Add UALink NPA VM mapping for ring buffersdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+432 -00 replies
35/95drm/amdgpu: Add UALink SDMA scheduler entitiesdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+53 -00 replies
36/95drm/amdgpu: Add UALink GART helpers for NPA address accessdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+75 -00 replies
37/95drm/amdgpu: Add UALink ring buffer allocation and firmware initdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+214 -00 replies
38/95drm/amdgpu: Add UALink remote command packets and SDMA dispatchdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+347 -00 replies
39/95drm/amdgpu: Add UALink firmware writeback address configurationdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+70 -00 replies
40/95drm/amdgpu: Add UALink cross-GPU TLB shootdown and remote interruptdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+244 -00 replies
41/95drm/amdgpu: Add UALink software init, teardown, and resetdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+96 -00 replies
42/95drm/amdgpu: Add UALink IH ring and enable interruptdrivers/gpu/drm/amd/amdgpu/amdgpu_irq.c drivers/gpu/drm/amd/amdgpu/amdgpu_irq.h drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c +1 more+112 -20 replies
43/95drm/amdgpu: UALink use LSDMA to send remote interrupt commanddrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+19 -00 replies
44/95drm/amdgpu: Create a drm client for UALink NPA BOsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+31 -00 replies
45/95drm/amdgpu: Control NPA DMA-buf importingdrivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c+5 -00 replies
46/95drm/amdgpu: Add ualink handle to BOsdrivers/gpu/drm/amd/amdgpu/amdgpu_object.h+3 -00 replies
47/95drm/amdgpu: Implement UALink handle exportdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+198 -00 replies
48/95drm/amdgpu: Add connection state managementdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+238 -10 replies
49/95drm/amdgpu: Implement UALink handle import ioctldrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+973 -00 replies
50/95drm/amdgpu: Implement mechanism to revoke exported memorydrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+252 -00 replies
51/95drm/amdgpu: lock UALink import invalidation via drm_execdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+30 -330 replies
52/95drm/amdgpu: Cleanup exported UALink handlesdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+343 -00 replies
53/95drm/amdgpu: Cleanup imported UALink handlesdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+31 -00 replies
54/95drm/amdgpu: Handle connection resetdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+202 -50 replies
55/95drm/amdgpu: Setup PTE mappings for NPA addressesdrivers/gpu/drm/amd/amdgpu/amdgpu_res_cursor.h drivers/gpu/drm/amd/amdgpu/amdgpu_vm.c drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c+32 -30 replies
56/95drm/amdgpu: Add handling for remote interruptsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+113 -40 replies
57/95drm/amdgpu: Send TLB shootdown on exported memory unmapdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+52 -170 replies
58/95drm/amdgpu: Handle local GPUs in UALink importdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+70 -00 replies
59/95drm/amdgpu: Add debugfs to drop UALink protocol messagesdrivers/gpu/drm/amd/amdgpu/amdgpu_debugfs.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+43 -00 replies
60/95drm/amdgpu: Temporarily disable sending remote TLB shootdownsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c+5 -00 replies
61/95drm/amdgpu: Temporarily Flush TLB on NPA mapping alwaysdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+0 -40 replies
62/95drm/amdgpu: log remote memory MTYPE for GC 12.1.0drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c+3 -10 replies
63/95drm/amdgpu: Prevent double-free of drm_execdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+21 -50 replies
64/95drm/amdgpu: fix NPA-RELEASE race in UALink exporter cleanupdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+11 -30 replies
65/95drm/amdgpu: initialize UALink importer node list headdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+1 -00 replies
66/95drm/amdgpu: Fix initialization flags for UALink XAsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+3 -30 replies
67/95drm/amdgpu: fix dma_buf leak in UALink exporter cleanupdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+6 -00 replies
68/95drm/amdgpu: Increase UALink soft ring sizedrivers/gpu/drm/amd/amdgpu/amdgpu_ih.h drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/ih_v7_0.c+10 -100 replies
69/95drm/amdgpu: Fix uninitialized fence in UALink NPA unmapdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+1 -10 replies
70/95drm/amdgpu: Use vm->last_update fence in UALink NPA unmap pathsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+14 -70 replies
71/95drm/amdgpu: Pin page tables in NPA VMsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_vm.c drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h +1 more+69 -30 replies
72/95drm/amdgpu: Initialize NPA PT/PDs to noretrydrivers/gpu/drm/amd/amdgpu/amdgpu_vm_pt.c+4 -00 replies
73/95drm/amdgpu: always use MTYPE_UC for remote memory on GFX 12.1drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c drivers/gpu/drm/amd/amdkfd/kfd_svm.c+7 -80 replies
74/95drm/amdkfd: program compute MQD coherent_aql_mtype on GFX 12.1drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c drivers/gpu/drm/amd/amdgpu/gmc_v12_1.h drivers/gpu/drm/amd/amdkfd/kfd_mqd_manager_v12_1.c +1 more+54 -190 replies
75/95drm/amdgpu: Separate out ualink init sequencesdrivers/gpu/drm/amd/amdgpu/amdgpu_device.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h +1 more+188 -1610 replies
76/95drm/amdgpu: Add ualink as separate ip blockdrivers/gpu/drm/amd/amdgpu/amdgpu_device.c drivers/gpu/drm/amd/amdgpu/amdgpu_discovery.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c +2 more+50 -310 replies
77/95drm/admgpu: Seggregate ualink nht messagingdrivers/gpu/drm/amd/amdgpu/Makefile drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h +2 more+185 -1010 replies
78/95drm/amdgpu: Assign accel state based on ASP configdrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c +1 more+278 -540 replies
79/95drm/amdgpu: Drop duplicate vpod check functionsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+4 -1210 replies
80/95drm/amdgpu: Add support to send ASP completiondrivers/gpu/drm/amd/amdgpu/amdgpu_psp.c drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h+31 -00 replies
81/95drm/amdgpu: Add handlers for ualink notificationsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h drivers/gpu/drm/amd/amdgpu/psp_gfx_if.h +1 more+143 -60 replies
82/95drm/amdgpu: Improve ualink state transitionsdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h+147 -500 replies
83/95drm/amdgpu: Use uniform logic for inband/sidebanddrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+57 -520 replies
84/95drm/amdgpu: Fix GART and SDMA entity leak on vPod reconfigurationdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+11 -50 replies
85/95drm/amdgpu: Add UALink diagnostic logging for vpod commit/activationdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+114 -420 replies
86/95drm/amdgpu: Handle UALink vPod reconfiguration while ACTIVEdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+57 -30 replies
87/95drm/amdgpu: Add name for ualink ip blockdrivers/gpu/drm/amd/amdgpu/amdgpu_ip.c+1 -00 replies
88/95drm/amdgpu: Cleanup UALink XA entries on manager stopdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+141 -120 replies
89/95drm/amdgpu: Move ualink ip version related changesdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h drivers/gpu/drm/amd/amdgpu/ualink_v1_0.c +1 more+63 -230 replies
90/95drm/amdgpu: Add hw_fini for ualinkdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h drivers/gpu/drm/amd/amdgpu/ualink_v1_0.c+15 -00 replies
91/95drm/amdgpu: Expose ualink info under each xcpdrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h drivers/gpu/drm/amd/amdgpu/amdgpu_xcp.c +1 more+181 -00 replies
92/95drm/amdgpu: Handle concurrent UALINK handle import racedrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+9 -30 replies
93/95drm/amdgpu: create UALink NPA import BO directly in the NPA domaindrivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c+18 -110 replies
94/95drm/amdgpu: add mtype_remote module parameterdrivers/gpu/drm/amd/amdgpu/amdgpu.h drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c +1 more+32 -180 replies
95/95drm/amdgpu: Honor mtype overrides for NPA remote memorydrivers/gpu/drm/amd/amdgpu/gmc_v12_1.c+6 -30 replies

Reviews trailers per patch

94 of 95 patches have a Reviewed-by or Acked-by.

PatchFelix KuehlingMukul JoshiChristian KönigHarish KasiviswanathanHawking ZhangPhilip YangLijo Lazar
1/95R-b R-b
2/95R-b R-b
3/95R-b
4/95R-b
5/95R-b
6/95R-b
7/95R-b
8/95R-b
9/95R-b
10/95R-b
11/95R-b
12/95R-b
13/95R-b
14/95R-b
15/95R-b
16/95R-b
17/95R-b
18/95R-b
19/95R-b
20/95R-b
21/95R-b
22/95A-b
23/95R-b
24/95R-b
25/95R-b
26/95R-b
27/95R-b
28/95R-b
29/95R-b
30/95R-b
31/95R-b
32/95R-b
33/95R-b
34/95R-b
35/95R-b
36/95R-b
37/95R-b
38/95R-b
39/95R-b
40/95R-b
41/95R-b
42/95R-b
43/95R-b
44/95R-b
45/95R-b
46/95R-b
47/95R-b
48/95R-b
49/95R-b
50/95R-b
51/95R-b
52/95R-b
53/95R-b
54/95R-b
55/95R-b
56/95R-b
57/95R-b
58/95R-b
59/95R-b
60/95R-b
61/95R-b
62/95R-b
63/95R-b
64/95R-b
65/95R-b
66/95R-b
67/95R-b
68/95R-b
69/95R-b
70/95R-b
71/95R-b
72/95R-b
73/95R-b
74/95R-b
75/95R-b
76/95A-b
77/95R-b
78/95R-b
79/95R-b
80/95R-b
81/95R-b
82/95R-b
83/95
84/95R-b
85/95R-b
86/95R-b
87/95R-b
88/95R-b
89/95R-b
90/95R-b
91/95R-b
92/95R-b
93/95R-b
94/95R-b
95/95R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 7 reviewers.

Read the v1 thread

Cover letter [PATCH 00/95] Add UALink instrastructure series 1

This adds the core infrastructure for supporting UALink (Ultra Accelerator Link) connected scale up pods. I've split this into two series, one to add the core infrastructure, and one to expose the new IOCTL interface and add the documentation to avoid spamming the larger audience with the implemenation defails. This is the first series.

This implements UALoE (UALink over Ethernet). An overview of the complete solution can be found here:
https://www.amd.com/en/products/rackscale-solutions/helios.html

Overview

Connected GPUs in a pod can directly access the remove memory on another GPU over UALink. Unlike RMDA, there is no copy involved; it is direct loads/stores over the fabric. Shared memory can only be accessed by a remote GPU if the memory was exported and the importer has been authorized. For the memory to be shared, it must be part of a unified physical address space shared between nodes. This address space is called NPA (Nework Physical Address) space. This address space is partitioned between the GPUs so that each GPU has it's own segment of the address space in which to export its memory. Each GPU maintains a dedicated set of page tables for their NPA space similar to GPUVM.

Exported memory is not pinned. The exporter may need to move memory or make it unavailable to the importers. This is handled via remote TLB shootdowns on the exporter in the case of TTM evictions or MMU notifiers and remote presense checks with retry on the importer.

To access remote memory, the driver can map NPA addresses into its per process GPUVM page tables just like local memory. Applications use opaque handles to represent remote memory. GPUs in a pod communicate with eachother directly to exchange NPA addresses between importers and exporters. If a node goes offline or is reset, their peers will clean up any remaining refrences that are lost when that happens.

User interface

Export Memory

To export memory, a handle must be created for an allocation that can be shared with another node in the pod. To do this the exporter calls the GEM UALink IOCTL with the GEM handle to the buffer it wants to export. The IOCTL returns a unique handle which can be shared with the remote host.

Import Memory

To import the memory, the handle from the remote node must be converted from a unique handle to a local GEM object which represents the local reference to the NPA space on the importer. If the memory has already been imported, it just returns a new reference to the existing object. If not, the importer queries the exporter to get the NPA address. Once it has that the importer can create a dma-buf to represent the NPA space used by the allocation and that is returned to the application.

Alex Sierra (1):
drm/amdgpu: log remote memory MTYPE for GC 12.1.0

Felix Kuehling (17):
drm/amdgpu: Add sysfs API for UALink information drm/amdgpu: Add sysfs API for UALink physical pod setup drm/amdgpu: Add sysfs API for UALink virtual pod config drm/amdgpu: Add sysfs API for UALink station configuration drm/amdgpu: Implement PSP cmd UAL_GET_CONFIG drm/amdgpu: Query initial UALink config from PSP drm/amdgpu: Implement PSP cmd UAL_SET_PPOD_CONFIG drm/amdgpu: Set physical pod configuration to PSP drm/amdgpu: Implement PSP cmd UAL_SET_VPOD_CONFIG drm/amdgpu: Set virtual pod configuration to PSP drm/amdgpu: Implement PSP cmd UAL_SET_STATION_CONFIG drm/amdgpu: Set UALink station config to PSP drm/amdgpu: Implement PSP cmd UAL_SET_NPA_CONFIG drm/amdgpu: Enable/disable NPA address translation using PSP drm/amdgpu: Prevent double-free of drm_exec drm/amdgpu: Pin page tables in NPA VMs
drm/amdgpu: Initialize NPA PT/PDs to noretry

Gangliang Xie (1):
drm/amdgpu: add handler for nHT error

Harish Kasiviswanathan (2):
drm/amdgpu: Add helper function to check psp xgmi ta drm/amdgpu: Add ual_config_state to ual_get_config

Jinzhou Su (1):
drm/amdgpu: Fix NULL pointer issue during ualink init

Le Ma (1):
drm/amdgpu: extend PSP command polling sleep range

Lijo Lazar (15):
drm/amdgpu: Add psp ualink command interfaces drm/amdgpu: Fetch asp ualink interface version drm/amdgpu: Separate out ualink init sequences drm/amdgpu: Add ualink as separate ip block drm/admgpu: Seggregate ualink nht messaging drm/amdgpu: Assign accel state based on ASP config drm/amdgpu: Drop duplicate vpod check functions drm/amdgpu: Add support to send ASP completion drm/amdgpu: Add handlers for ualink notifications drm/amdgpu: Improve ualink state transitions drm/amdgpu: Use uniform logic for inband/sideband drm/amdgpu: Add name for ualink ip block drm/amdgpu: Move ualink ip version related changes drm/amdgpu: Add hw_fini for ualink drm/amdgpu: Expose ualink info under each xcp

Mukul Joshi (42):
drm/amdgpu: Add UALink manager core infrastructure drm/amdgpu: Add a new NPA Address space
drm/amdgpu: Add address allocator for NPA addresses drm/amdgpu: Initialize VM for NPA addr management drm/amdgpu: Rework VMID reservation logic
drm/amdgpu: Reserve VMID for NPA VM
drm/amdgpu: Use reserved VMID for NPA VM
drm/amdgpu: Enable UALink Manager when pod becomes active drm/amdgpu: Create a drm client for UALink NPA BOs drm/amdgpu: Control NPA DMA-buf importing
drm/amdgpu: Add ualink handle to BOs
drm/amdgpu: Implement UALink handle export
drm/amdgpu: Add connection state management
drm/amdgpu: Implement UALink handle import ioctl drm/amdgpu: Implement mechanism to revoke exported memory drm/amdgpu: lock UALink import invalidation via drm_exec drm/amdgpu: Cleanup exported UALink handles
drm/amdgpu: Cleanup imported UALink handles
drm/amdgpu: Handle connection reset
drm/amdgpu: Setup PTE mappings for NPA addresses drm/amdgpu: Add handling for remote interrupts drm/amdgpu: Send TLB shootdown on exported memory unmap drm/amdgpu: Handle local GPUs in UALink import drm/amdgpu: Add debugfs to drop UALink protocol messages drm/amdgpu: Temporarily disable sending remote TLB shootdowns drm/amdgpu: Temporarily Flush TLB on NPA mapping always drm/amdgpu: fix NPA-RELEASE race in UALink exporter cleanup drm/amdgpu: initialize UALink importer node list head drm/amdgpu: Fix initialization flags for UALink XAs drm/amdgpu: fix dma_buf leak in UALink exporter cleanup drm/amdgpu: Fix uninitialized fence in UALink NPA unmap drm/amdgpu: Use vm->last_update fence in UALink NPA unmap paths drm/amdgpu: always use MTYPE_UC for remote memory on GFX 12.1 drm/amdkfd: program compute MQD coherent_aql_mtype on GFX 12.1 drm/amdgpu: Fix GART and SDMA entity leak on vPod reconfiguration drm/amdgpu: Add UALink diagnostic logging for vpod commit/activation drm/amdgpu: Handle UALink vPod reconfiguration while ACTIVE drm/amdgpu: Cleanup UALink XA entries on manager stop drm/amdgpu: Handle concurrent UALINK handle import race drm/amdgpu: create UALink NPA import BO directly in the NPA domain drm/amdgpu: add mtype_remote module parameter
drm/amdgpu: Honor mtype overrides for NPA remote memory

Philip Yang (15):
drm/amdgpu: Fix UALink vPod double-activation drm/amdgpu: Add UALink remote state structures and API declarations drm/amdgpu: Add UALink NPA address layout helpers drm/amdgpu: Add UALink NPA address computation for ring buffers drm/amdgpu: Add UALink NPA VM mapping for ring buffers drm/amdgpu: Add UALink SDMA scheduler entities drm/amdgpu: Add UALink GART helpers for NPA address access drm/amdgpu: Add UALink ring buffer allocation and firmware init drm/amdgpu: Add UALink remote command packets and SDMA dispatch drm/amdgpu: Add UALink firmware writeback address configuration drm/amdgpu: Add UALink cross-GPU TLB shootdown and remote interrupt drm/amdgpu: Add UALink software init, teardown, and reset drm/amdgpu: Add UALink IH ring and enable interrupt drm/amdgpu: UALink use LSDMA to send remote interrupt command drm/amdgpu: Increase UALink soft ring size

 drivers/gpu/drm/amd/amdgpu/Makefile           |    3 +
 drivers/gpu/drm/amd/amdgpu/amdgpu.h           |    5 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_debugfs.c   |   14 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_device.c    |    2 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_discovery.c |   21 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_dma_buf.c   |    5 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c       |    7 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_gfx.h       |    1 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_ids.c       |   33 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_ids.h       |   27 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_ih.h        |    1 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_ip.c        |    1 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_irq.c       |   17 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_irq.h       |    7 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_object.c    |   11 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_object.h    |    5 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_psp.c       |  280 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_psp.h       |   27 +
 .../gpu/drm/amd/amdgpu/amdgpu_res_cursor.h    |    1 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c       |   17 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.h       |    4 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c    | 6174 +++++++++++++++++
 drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h    |  421 ++
 drivers/gpu/drm/amd/amdgpu/amdgpu_vm.c        |   44 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_vm.h        |    4 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_vm_pt.c     |   29 +-
 drivers/gpu/drm/amd/amdgpu/amdgpu_xcp.c       |    6 +
 drivers/gpu/drm/amd/amdgpu/amdgpu_xcp.h       |    7 +
 drivers/gpu/drm/amd/amdgpu/gfx_v10_0.c        |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v11_0.c        |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v12_0.c        |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v12_1.c        |   51 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v7_0.c         |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v8_0.c         |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v9_0.c         |    2 +-
 drivers/gpu/drm/amd/amdgpu/gfx_v9_4_3.c       |    2 +-
 drivers/gpu/drm/amd/amdgpu/gmc_v10_0.c        |    4 +
 drivers/gpu/drm/amd/amdgpu/gmc_v11_0.c        |    5 +
 drivers/gpu/drm/amd/amdgpu/gmc_v12_0.c        |   26 +-
 drivers/gpu/drm/amd/amdgpu/gmc_v12_1.c        |   98 +-
 drivers/gpu/drm/amd/amdgpu/gmc_v12_1.h        |    1 +
 drivers/gpu/drm/amd/amdgpu/gmc_v6_0.c         |    6 +
 drivers/gpu/drm/amd/amdgpu/gmc_v7_0.c         |    6 +
 drivers/gpu/drm/amd/amdgpu/gmc_v8_0.c         |    6 +
 drivers/gpu/drm/amd/amdgpu/gmc_v9_0.c         |    6 +
 drivers/gpu/drm/amd/amdgpu/ih_v7_0.c          |    8 +
 drivers/gpu/drm/amd/amdgpu/psp_gfx_if.h       |  162 +
 drivers/gpu/drm/amd/amdgpu/psp_v15_0_8.c      |   48 +-
 drivers/gpu/drm/amd/amdgpu/soc_v1_0.c         |    6 -
 drivers/gpu/drm/amd/amdgpu/ualink_v1_0.c      |  143 +
 drivers/gpu/drm/amd/amdgpu/ualink_v1_0.h      |   30 +
 .../drm/amd/amdkfd/kfd_mqd_manager_v12_1.c    |    7 +
 drivers/gpu/drm/amd/amdkfd/kfd_svm.c          |    8 +-
 drivers/gpu/drm/amd/include/amd_shared.h      |    2 +
 .../ivsrcid/mpnht/irqsrcs_mpnht_15_0.h        |   30 +
 drivers/gpu/drm/amd/include/v12_structs.h     |    2 +-
 include/drm/ttm/ttm_resource.h                |    2 +-
 include/uapi/drm/amdgpu_drm.h                 |    6 +
 58 files changed, 7782 insertions(+), 69 deletions(-)
 create mode 100644 drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.c
 create mode 100644 drivers/gpu/drm/amd/amdgpu/amdgpu_ualink.h
 create mode 100644 drivers/gpu/drm/amd/amdgpu/ualink_v1_0.c
 create mode 100644 drivers/gpu/drm/amd/amdgpu/ualink_v1_0.h
 create mode 100644 drivers/gpu/drm/amd/include/ivsrcid/mpnht/irqsrcs_mpnht_15_0.h
Signature · 1 line
2.55.0