Skip to contentSkip to conversation

DMA-API: cacheline tracking ENOMEM, dma-debug disabled due to nouveau ?

DISCUSSION Corentin Labbe 4 participants 6 messages Aug 14, 2019 – Aug 16, 2019

lore
Share & tools
lore
#0 lore raw

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

      6 ahci
    257 e1000e
      6 ehci-pci
   5891 nouveau
     24 uhci_hcd

Does nouveau having this high number of DMA mapping is normal ?

Regards

#1 lore raw
Quoted 7 lines · Corentin Labbe

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

Quoted 7 lines
      6 ahci
    257 e1000e
      6 ehci-pci
   5891 nouveau
     24 uhci_hcd

Does nouveau having this high number of DMA mapping is normal ?

Yeah seems perfectly fine for a gpu.
-Daniel

Signature · 3 lines
Daniel Vetter
Software Engineer, Intel Corporation
http://blog.ffwll.ch
#2 lore raw
Quoted 14 lines · Daniel Vetter
Quoted 13 lines · Corentin Labbe

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

      6 ahci
    257 e1000e
      6 ehci-pci
   5891 nouveau
     24 uhci_hcd
Quoted 3 lines
Quoted 1 line

Does nouveau having this high number of DMA mapping is normal ?

Yeah seems perfectly fine for a gpu.

That is a lot and apparently overwhelm the dma-debug tracking. Robin rewrote this code in Linux 4.21 to work a little better, so I'm curious why this might have changes in 4.19, as dma-debug did not change at all there.

#3 lore raw
Quoted 15 lines · Christoph Hellwig
Quoted 14 lines · Daniel Vetter
Quoted 13 lines · Corentin Labbe

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

       6 ahci
     257 e1000e
       6 ehci-pci
    5891 nouveau
      24 uhci_hcd
Quoted 8 lines
Quoted 3 lines
Quoted 1 line

Does nouveau having this high number of DMA mapping is normal ?

Yeah seems perfectly fine for a gpu.

That is a lot and apparently overwhelm the dma-debug tracking. Robin rewrote this code in Linux 4.21 to work a little better, so I'm curious why this might have changes in 4.19, as dma-debug did not change at all there.

FWIW, the cacheline tracking entries are a separate thing from the dma-debug entries that I rejigged - judging by those numbers there should still be plenty of free dma-debug entries, but for some reason it has failed to extend the radix tree :/

Robin.

#4 lore raw
In reply to Daniel Vetter
Quoted 14 lines · Daniel Vetter
Quoted 13 lines · Corentin Labbe

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

      6 ahci
    257 e1000e
      6 ehci-pci
   5891 nouveau
     24 uhci_hcd
Quoted 3 lines
Quoted 1 line

Does nouveau having this high number of DMA mapping is normal ?

Yeah seems perfectly fine for a gpu.

Note that it never go down and when I terminate my X session, it stays the same. So without any "real" GPU work, does it is still normal to have so many active mapping ?

For example, when doing some transfer, the ahci mapping number changes and then always go down to 6.

#5 lore raw
Quoted 15 lines · Corentin Labbe
Quoted 14 lines · Daniel Vetter
Quoted 13 lines · Corentin Labbe

Hello

Since lot of release (at least since 4.19), I hit the following error message:
DMA-API: cacheline tracking ENOMEM, dma-debug disabled

After hitting that, I try to check who is creating so many DMA mapping and see:
cat /sys/kernel/debug/dma-api/dump | cut -d' ' -f2 | sort | uniq -c

      6 ahci
    257 e1000e
      6 ehci-pci
   5891 nouveau
     24 uhci_hcd
Quoted 6 lines
Quoted 3 lines
Quoted 1 line

Does nouveau having this high number of DMA mapping is normal ?

Yeah seems perfectly fine for a gpu.

Note that it never go down and when I terminate my X session, it stays the same. So without any "real" GPU work, does it is still normal to have so many active mapping ?

Might just be the dma_alloc cache. It should go down under memory pressure I think. Otherwise might also be a leak.

Quoted 1 line

For example, when doing some transfer, the ahci mapping number changes and then always go down to 6.

gpu drivers tend to cache everything, all the time ... -Daniel

Signature · 3 lines
Daniel Vetter
Software Engineer, Intel Corporation
+41 (0) 79 365 57 48 - http://blog.ffwll.ch