Skip to content

nvme: NUMA locality for fabrics

Keith Busch linux-nvme 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v3 Latest0 of 3 patches 0 repliesNew

Patches in v3 No applies recorded yet

None of the 3 patches the cover letter announces are in this archive.

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v3 yet.

Read the v3 thread

Cover letter [PATCHv3 0/3] nvme: NUMA locality for fabrics
Quoted 9 lines · Christoph Hellwig
Quoted 4 lines · Hannes Reinecke

Fully agreed here.
It all comes down to the link latency.
If the link latency is the main bottleneck multipathing will benefit from round-robin (or any I/O scheduler, for that matter).

It still makes a lot more sense to try to have queues with an affinity to a given path rather than doing round robin IFF you care about latency.

Quoted 8 lines

If you latency sucks anyway round robing makes sense. But why do you use nvme on such a horrible interconnect anyway?

Quoted 3 lines

And this it not just relevant for 'legacy' hardware; I've seen a performance benefit on a 32G FC setup, which is pretty much state of the art currently.

Well, FC is legacy no matter which link speed.

Fabrics has a required Identify Controller field called "MAXCMD" which is a per-queue limiter. A sufficiently shallow value with a high queue depth workload could justify round-robin'ing your queues.