Skip to contentSkip to conversation

NVMe: Set affinity after allocating request queues

PATCH New Keith Busch 3 participants 5 messages Sep 3, 2015 – Sep 23, 2015

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 NVMe: Set affinity after allocating request queues

The asynchronous namespace scanning caused affinity hints to be set before its tagset initialized, so there was no cpu mask to set the hint. This patch moves the affinity hint setting to after namespaces are scanned.

Reported-by ??? <ks0204.kim at samsung.com>
Signed-off-by Keith Busch <keith.busch at intel.com>
---
 drivers/block/nvme-core.c |   36 +++++++++++++++++-------------------
 1 file changed, 17 insertions(+), 19 deletions(-)
drivers/block/nvme-core.c +17 -19
index b97fc3f..30758bd 100644
@@ -2439,6 +2439,22 @@ static void nvme_scan_namespaces(struct nvme_dev *dev, unsigned nn)
 	list_sort(NULL, &dev->namespaces, ns_cmp);
 }
 
+static void nvme_set_irq_hints(struct nvme_dev *dev)
+{
+	struct nvme_queue *nvmeq;
+	int i;
+
+	for (i = 0; i < dev->online_queues; i++) {
+		nvmeq = dev->queues[i];
+
+		if (!nvmeq->tags || !(*nvmeq->tags))
+			continue;
+
+		irq_set_affinity_hint(dev->entry[nvmeq->cq_vector].vector,
+					blk_mq_tags_cpumask(*nvmeq->tags));
+	}
+}
+
 static void nvme_dev_scan(struct work_struct *work)
 {
 	struct nvme_dev *dev = container_of(work, struct nvme_dev, scan_work);
@@ -2450,6 +2466,7 @@ static void nvme_dev_scan(struct work_struct *work)
 		return;
 	nvme_scan_namespaces(dev, le32_to_cpup(&ctrl->nn));
 	kfree(ctrl);
+	nvme_set_irq_hints(dev);
 }
 
 /*
@@ -2953,22 +2970,6 @@ static const struct file_operations nvme_dev_fops = {
 	.compat_ioctl	= nvme_dev_ioctl,
 };
 
-static void nvme_set_irq_hints(struct nvme_dev *dev)
-{
-	struct nvme_queue *nvmeq;
-	int i;
-
-	for (i = 0; i < dev->online_queues; i++) {
-		nvmeq = dev->queues[i];
-
-		if (!nvmeq->tags || !(*nvmeq->tags))
-			continue;
-
-		irq_set_affinity_hint(dev->entry[nvmeq->cq_vector].vector,
-					blk_mq_tags_cpumask(*nvmeq->tags));
-	}
-}
-
 static int nvme_dev_start(struct nvme_dev *dev)
 {
 	int result;
@@ -3010,8 +3011,6 @@ static int nvme_dev_start(struct nvme_dev *dev)
 	if (result)
 		goto free_tags;
 
-	nvme_set_irq_hints(dev);
-
 	dev->event_limit = 1;
 	return result;
 
@@ -3062,7 +3061,6 @@ static int nvme_dev_resume(struct nvme_dev *dev)
 	} else {
 		nvme_unfreeze_queues(dev);
 		nvme_dev_add(dev);
-		nvme_set_irq_hints(dev);
 	}
 	return 0;
 }
Signature · 1 line
1.7.10.4
#1 lore raw

PATCH 1/1 NVMe: Set affinity after allocating request queues

Hello, Keith Busch.
Thank you for the patch. I've confirmed that setting hint is now working with the patch.

However, I think setting affinity hint is not sufficient to balance interrupts.
We've observed that affinity hint has not much impact on distributing interrupts across cores on a distro such as debian 7.0 while setting affinity directly has worked on the distro.

Plus, hint information is also provided by device driver with intention that balances interrupt loads across cores. And it also needs to collaborate with irqbalance option to work on.
So, I think setting affinity is a clear way to achieve balancing effect provided by driver rather than hint information. I hope to listen your opinion regarding this.

-----Original Message-----
From: Linux-nvme [mailto:[email protected]] On Behalf Of Keith Busch
Sent: Thursday, September 03, 2015 11:18 PM
To: linux-nvme at lists.infradead.org
Cc: ???; Keith Busch
Subject: [PATCH] NVMe: Set affinity after allocating request queues

The asynchronous namespace scanning caused affinity hints to be set before its tagset initialized, so there was no cpu mask to set the hint. This patch moves the affinity hint setting to after namespaces are scanned.

Reported-by ??? <ks0204.kim at samsung.com>
Signed-off-by Keith Busch <keith.busch at intel.com>
---
 drivers/block/nvme-core.c |   36 +++++++++++++++++-------------------
 1 file changed, 17 insertions(+), 19 deletions(-)
drivers/block/nvme-core.c +15 -0
@@ -2439,6 +2439,22 @@ static void nvme_scan_namespaces(struct nvme_dev *dev, unsigned nn)
 	list_sort(NULL, &dev->namespaces, ns_cmp);  }
 
+static void nvme_set_irq_hints(struct nvme_dev *dev) {
+	struct nvme_queue *nvmeq;
+	int i;
+
+	for (i = 0; i < dev->online_queues; i++) {
+		nvmeq = dev->queues[i];
+
+		if (!nvmeq->tags || !(*nvmeq->tags))
+			continue;
+
+		irq_set_affinity_hint(dev->entry[nvmeq->cq_vector].vector,
+					blk_mq_tags_cpumask(*nvmeq->tags));
+	}
+}
+
 static void nvme_dev_scan(struct work_struct *work)  {
 	struct nvme_dev *dev = container_of(work, struct nvme_dev, scan_work); @@ -2450,6 +2466,7 @@ static void nvme_dev_scan(struct work_struct *work)
 		return;
 	nvme_scan_namespaces(dev, le32_to_cpup(&ctrl->nn));

kfree(ctrl);
+ nvme_set_irq_hints(dev);
}

/*
@@ -2953,22 +2970,6 @@ static const struct file_operations nvme_dev_fops = {
.compat_ioctl = nvme_dev_ioctl,
};

-static void nvme_set_irq_hints(struct nvme_dev *dev) -{
- struct nvme_queue *nvmeq;
- int i;
-
- for (i = 0; i < dev->online_queues; i++) {
- nvmeq = dev->queues[i];
-
- if (!nvmeq->tags || !(*nvmeq->tags))
- continue;
-
- irq_set_affinity_hint(dev->entry[nvmeq->cq_vector].vector,
- blk_mq_tags_cpumask(*nvmeq->tags));
- }
-}
-
static int nvme_dev_start(struct nvme_dev *dev) {
int result;
@@ -3010,8 +3011,6 @@ static int nvme_dev_start(struct nvme_dev *dev)
if (result)
goto free_tags;

- nvme_set_irq_hints(dev);
-
dev->event_limit = 1;
return result;

@@ -3062,7 +3061,6 @@ static int nvme_dev_resume(struct nvme_dev *dev)
} else {
nvme_unfreeze_queues(dev); nvme_dev_add(dev);
- nvme_set_irq_hints(dev);
}
return 0;
}
--
1.7.10.4

_______________________________________________
Linux-nvme mailing list
Linux-nvme at lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-nvme

#2 lore raw

PATCH 1/1 NVMe: Set affinity after allocating request queues

Quoted 11 lines · ???

Hello, Keith Busch.
Thank you for the patch. I've confirmed that setting hint is now working with the patch.

However, I think setting affinity hint is not sufficient to balance interrupts.
We've observed that affinity hint has not much impact on distributing interrupts across cores on a distro such as debian 7.0 while setting affinity directly has worked on the distro.

Plus, hint information is also provided by device driver with intention that balances interrupt loads across cores. And it also needs to collaborate with irqbalance option to work on.
So, I think setting affinity is a clear way to achieve balancing effect provided by driver rather than hint information. I hope to listen your opinion regarding this.

No argument from me against having an API to directly set the irq affinity. I think it's a great idea.

This patch just puts the hint where it ought to be. My machines have a different patch that create a request_queue without a namespace (for hidden access), so I didn't notice the async scanning broke the hint on mainline.

With this patch, and when the new irq affinity set function is exported (assuming that is being done), you can just change the irq_set_affinity_hint() to the new function.

#3 lore raw

PATCH 1/1 NVMe: Set affinity after allocating request queues

In reply to Keith Busch
Quoted 3 lines · Keith Busch

The asynchronous namespace scanning caused affinity hints to be set before its tagset initialized, so there was no cpu mask to set the hint. This patch moves the affinity hint setting to after namespaces are scanned.

Hi Jens,

Would it be okay to get this merged in for 4.3? The affinity hint is very important to top out performance, so this should be considered a bug that the setting wasn't correct.

Thanks,
Keith

Quoted 10 lines
Reported-by ??? <ks0204.kim at samsung.com>
Signed-off-by Keith Busch <keith.busch at intel.com>

---
drivers/block/nvme-core.c | 36 +++++++++++++++++-------------------

1 file changed, 17 insertions(+), 19 deletions(-)
drivers/block/nvme-core.c +0 -0
index b97fc3f..30758bd 100644
#4 lore raw

PATCH 1/1 NVMe: Set affinity after allocating request queues

Quoted 11 lines · Keith Busch
Quoted 4 lines · Keith Busch

The asynchronous namespace scanning caused affinity hints to be set before
its tagset initialized, so there was no cpu mask to set the hint. This patch moves the affinity hint setting to after namespaces are scanned.

Hi Jens,

Would it be okay to get this merged in for 4.3? The affinity hint is very important to top out performance, so this should be considered a bug that the setting wasn't correct.

I haven't seen this patch, but yes if it's not setting the right hints, then it should be fixed as that is certainly a potentially big performance issue. In general we're still in dire need of having a proper way of having this done without a lot of driver interaction. I'd really love to see a framework that just has the driver ask blk-mq for a set of handlers, and blk-mq will set with the hints that it has already assigned. I might even have promised to write this, I should get around to do that... But I don't think it should be a gating factor for this fix, though it still needs to get done.

Signature · 1 line
Jens Axboe