RDMA/mlx5: Enable Relaxed Ordering by default for kernel ULPs
Subsystems (2)
PATCH v2 1/1 RDMA/mlx5: Enable Relaxed Ordering by default for kernel ULPs
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]
--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)
drivers/infiniband/hw/mlx5/mr.c +6 -4
@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));
@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );
@@ -812,7 +813,8 @@ struct ib_mr *mlx5_ib_get_dma_mr(struct ib_pd *pd, int acc)MLX5_SET (mkc, mkc, access_mode_1_0,MLX5_MKC_ACCESS_MODE_PA );MLX5_SET (mkc, mkc, length64,1 ); -set_mkc_access_pd_addr_fields (mkc, acc,0 , pd); +set_mkc_access_pd_addr_fields (mkc, acc |IB_ACCESS_RELAXED_ORDERING ,0 , + pd); err =mlx5_ib_create_mkey (dev, &mr->mmkey, in, inlen);if (err)
@@ -2022,7 +2024,7 @@ static void mlx5_set_umr_free_mkey(struct ib_pd *pd, u32 *in, int ndescs, mkc =MLX5_ADDR_OF (create_mkey_in, in, memory_key_mkey_entry);/* This is only used from the kernel, so setting the PD is OK. */ -set_mkc_access_pd_addr_fields (mkc,0 ,0 , pd); +set_mkc_access_pd_addr_fields (mkc,IB_ACCESS_RELAXED_ORDERING ,0 , pd);MLX5_SET (mkc, mkc, free,1 );MLX5_SET (mkc, mkc, translations_octword_size, ndescs);MLX5_SET (mkc, mkc, access_mode_1_0, access_mode &0x3 );
drivers/infiniband/hw/mlx5/wr.c +4 -1
@@ -866,7 +866,10 @@ static int set_reg_wr(struct mlx5_ib_qp *qp,bool atomic = wr->access &IB_ACCESS_REMOTE_ATOMIC ;u8 flags =0 ; -/* Matches access in mlx5_set_umr_free_mkey() */ +/* Matches access in mlx5_set_umr_free_mkey(). +* Relaxed Ordering is set implicitly in mlx5_set_umr_free_mkey() and +* kernel ULPs are not aware of it, so we don't set it here. +*/ if (!mlx5_ib_can_reconfig_with_umr (dev,0 , wr->access)) { mlx5_ib_warn( to_mdev(qp->ibqp.device),
Signature · 1 line
2.31.1
Quoted 8 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Quoted 7 lines
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
This looks great in terms of code changes. But can we please also add a patch to document that PCIe relaxed ordering is fine for kernel ULP usage somewhere?
Quoted 17 lines · Christoph Hellwig
Quoted 8 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Quoted 7 lines
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
Quoted 3 lines
This looks great in terms of code changes. But can we please also add a patch to document that PCIe relaxed ordering is fine for kernel ULP usage somewhere?
Sure, did you have in mind some concrete place? Or will new file in the Documentation/infiniband/ folder be good enough too?
Thanks
Quoted 2 lines · Leon Romanovsky
Sure, did you have in mind some concrete place? Or will new file in the
Documentation/infiniband/folder be good enough too?
Maybe add a kerneldoc comment for the map_mr_sg() ib_device_ops method?
Quoted 5 lines · Christoph Hellwig
Quoted 2 lines · Leon Romanovsky
Sure, did you have in mind some concrete place? Or will new file in the
Documentation/infiniband/folder be good enough too?Maybe add a kerneldoc comment for the
map_mr_sg()ib_device_opsmethod?
I hope that this hunk from the previous cover letter is good enough.
Jason, do you want v3? or you can fold this into v2?
include/rdma/ib_verbs.h +7 -0
@@ -2468,6 +2468,13 @@ struct ib_device_ops { enum ib_uverbs_advise_mr_advice advice, u32 flags, struct ib_sge *sg_list, u32 num_sge, struct uverbs_attr_bundle *attrs); +/* +* Kernel users should universally support relaxed ordering (RO), +* as they are designed to read data only after observing the CQE +* and use the DMA API correctly. +* +* Some drivers implicitly enable RO if platform supports it. +*/ int (*map_mr_sg)(struct ib_mr *mr,struct scatterlist *sg,int sg_nents,unsigned int *sg_offset); int (*check_mr_status)(struct ib_mr *mr, u32 check_mask,
From: Christoph Hellwig
Quoted 19 lines
Sent: 09 June 2021 13:53
Quoted 8 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Quoted 7 lines
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
Quoted 3 lines
This looks great in terms of code changes. But can we please also add a patch to document that PCIe relaxed ordering is fine for kernel ULP usage somewhere?
Several things need to happen to use relaxed ordering:
1) The pcie target has to be able to use RO for buffer writes and non-RO for control writes.
2) The Linux driver has to enable (1).
3) The generic Linux kernel has to 'not mask' RO on all the PCIe bridges and root.
4) The hardware memory system has to 'not break' when passes a RO write.
The comments about the DMA API are almost pointless. They'd only be relevant if the driver has looking for the last byte of a buffer to change - and then assuming the rest is valid.
This patch looks like a driver patch - so is changing (2) above.
I've seen another patch that (I think) is enabling (3). Although some X86 cpu are known to be broken (aka 4).
And I still don't know what a ULP is.
I actually know a bit about TLP.
I found (and fixed) a bug in the Altera/Intel fpga logic where it didn't like receiving two data TLP in response to a single read TLP.
We've also (now) got logic in the fpga that traces all received and sent TLP to an internal memory block.
So I can see what the cpus we have actually generate.
David
-
Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK Registration No: 1397386 (Wales)
Hi David-
Quoted 3 lines · David Laight
And I still don't know what a ULP is.
Upper Layer Protocol.
That's a generic term for an RDMA verbs consumer, like NVMe or RPC-over-RDMA.
--
Chuck Lever
From: Chuck Lever III
Quoted 4 lines
Sent: 09 June 2021 15:37
Hi David-
Quoted 8 lines
Quoted 3 lines · David Laight
And I still don't know what a ULP is.
Upper Layer Protocol.
That's a generic term for an RDMA verbs consumer, like NVMe or RPC-over-RDMA.
No wonder I don't spot what it meant.
I'm guessing you have something specific in mind for RDMA as well.
Don't assume that everyone has read all the high level protocol specs (and remembers the all the TLA (and ETLA)) when talking about very low level hardware features.
Especially when you are also referring to how the 'relaxed ordering' bit of a PCIe write TLP is processed.
This all makes your commit message even less meaningful.
In principle some writel() could generate PCIe write TLP (going to the target) that have the 'relaxed ordering' bit set. So a ULP that supports relaxed ordering could actually expect to generate them - even though there is probably no method of setting the bit.
Although, in principle, I guess that areas that are 'prefetchable' (for reads) could be deemed suitable for relaxed writes. (That way probably lies madness and a load of impossible to fix timing bugs!)
David
-
Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK Registration No: 1397386 (Wales)
Jason Gunthorpe
maintainerQuoted 2 lines · David Laight
In principle some
writel()could generate PCIe write TLP (going to the target) that have the 'relaxed ordering' bit set.
In Linux we call this writel_relaxed(), though I know of no implementation that sets the RO bit in the TLP based on this, it would be semantically correct to do so.
writel() has strong order requirements and must not generate a RO TLP.
Jason
From: Jason Gunthorpe
Quoted 4 lines
Sent: 09 June 2021 16:09
On Wed, Jun 09, 2021 at 03:05:52PM +0000, David Laight wrote:
Quoted 8 lines
Quoted 2 lines
In principle some
writel()could generate PCIe write TLP (going to the target) that have the 'relaxed ordering' bit set.In Linux we call this
writel_relaxed(), though I know of no implementation that sets the RO bit in the TLP based on this, it would be semantically correct to do so.
writel()has strong order requirements and must not generate a RO TLP.
Somewhere I'd forgotten about that :-(
It usually just allows the compiler and cpu hardware re-sequence the bus cycles.
OTOH I doubt any/many PCIe targets have 'memory' areas that would benefit from RO write TLP.
Especially since everything is organised to use target issued buffer copies.
I'm guessing that the benefits from RO are when the writes hit memory that is on a NUMA node or 'differently cached'.
So writes to once cache line can proceed while earlier writes are still waiting for the cache-coherency protocol.
From what I've seen writel() aren't too bad - they are async. The real problem is readl().
The x86 cpu I have use a separate TLP id (I've forgotten the correct term) for each cpu core.
So while multiple cpu can (and do) issue concurrent reads, reads from a single cpu happen one TLP at a time - even though it would be legitimate for the out-of-order execution unit to issue additional read TLP. There are times when you really do have to do PIO buffer reads :-(
David
-
Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK Registration No: 1397386 (Wales)
Quoted 18 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]
Quoted 4 lines
--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)
Applied to for-next, with the extra comment, thanks
Someone is working on dis-entangling the access flags? It took a long time to sort out that this mess in wr.c actually does have a distinct user/kernel call chain too..
Jason
Quoted 3 lines · Jason Gunthorpe
Someone is working on dis-entangling the access flags? It took a long time to sort out that this mess in
wr.cactually does have a distinct user/kernel call chain too..
I'd love to see it done, but I won't find time for it anytime soon.
Jason Gunthorpe
maintainerQuoted 6 lines · Christoph Hellwig
Quoted 3 lines · Jason Gunthorpe
Someone is working on dis-entangling the access flags? It took a long time to sort out that this mess in
wr.cactually does have a distinct user/kernel call chain too..I'd love to see it done, but I won't find time for it anytime soon.
Heh, me too..
I did actually once try to get a start on doing something to wr.c but it rapidly started to get into mire..
I thought I recalled Leon saying he or Avihai would work on the ACCESS thing anyhow?
Thanks,
Jason
Quoted 8 lines · Jason Gunthorpe
Quoted 6 lines · Christoph Hellwig
Quoted 3 lines · Jason Gunthorpe
Someone is working on dis-entangling the access flags? It took a long time to sort out that this mess in
wr.cactually does have a distinct user/kernel call chain too..I'd love to see it done, but I won't find time for it anytime soon.
Quoted 7 lines
Heh, me too..
I did actually once try to get a start on doing something to
wr.cbut it rapidly started to get into mire..I thought I recalled Leon saying he or Avihai would work on the ACCESS thing anyhow?
Yes, we are planning to do it for the next cycle.
Thanks
Quoted 3 lines
Thanks,
Jason
Quoted 36 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +1
-0@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));
drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 85
Quoted 9 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);
Jason,
If it's still possible to add small change, it will be nice to avoid calculating "acc & IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled" twice.
Quoted 48 lines · Max Gurtovoy
Quoted 35 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +1
-0@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 84
Quoted 8 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);Jason,
Quoted 2 lines
If it's still possible to add small change, it will be nice to avoid calculating "acc &
IB_ACCESS_RELAXED_ORDERING&&ro_pci_enabled" twice.
The patch is part of for-next now, so feel free to send followup patch.
Thanks
drivers/infiniband/hw/mlx5/mr.c +4 -5
@@ -69,7 +69,8 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); -bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev); +bool ro_pci_enabled = acc &IB_ACCESS_RELAXED_ORDERING && +pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));
@@ -78,11 +79,9 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,MLX5_SET (mkc, mkc, lr,1 );if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write)) -MLX5_SET (mkc, mkc, relaxed_ordering_write, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_write, ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read)) -MLX5_SET (mkc, mkc, relaxed_ordering_read, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_read, ro_pci_enabled);MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );
(END)
Quoted 2 lines
Quoted 81 lines · Leon Romanovsky
Quoted 46 lines · Max Gurtovoy
Quoted 35 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +1
-0@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 84
Quoted 8 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);Jason,
Quoted 2 lines
If it's still possible to add small change, it will be nice to avoid calculating "acc &
IB_ACCESS_RELAXED_ORDERING&&ro_pci_enabled" twice.The patch is part of for-next now, so feel free to send followup patch.
Thanks
drivers/infiniband/hw/mlx5/mr.c +4
-5@@ -69,7 +69,8 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); -bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev); +bool ro_pci_enabled = acc &IB_ACCESS_RELAXED_ORDERING && +pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));@@ -78,11 +79,9 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,MLX5_SET (mkc, mkc, lr,1 );if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write)) -MLX5_SET (mkc, mkc, relaxed_ordering_write, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_write, ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read)) -MLX5_SET (mkc, mkc, relaxed_ordering_read, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_read, ro_pci_enabled);MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );
Quoted 2 lines
(END)
Yes this looks good.
Can you/Avihai create a patch from this ? or I'll do it ?
Quoted 1 line
Quoted 1 line
Jason Gunthorpe
maintainerQuoted 77 lines · Max Gurtovoy
Quoted 75 lines · Leon Romanovsky
Quoted 43 lines · Max Gurtovoy
Quoted 32 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +2
-0+++ b/drivers/infiniband/hw/mlx5/mr.c@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 84
Quoted 8 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);Jason,
Quoted 2 lines
If it's still possible to add small change, it will be nice to avoid calculating "acc &
IB_ACCESS_RELAXED_ORDERING&&ro_pci_enabled" twice.The patch is part of for-next now, so feel free to send followup patch.
Thanks
drivers/infiniband/hw/mlx5/mr.c +5
-5+++ b/drivers/infiniband/hw/mlx5/mr.c@@ -69,7 +69,8 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); -bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev); +bool ro_pci_enabled = acc &IB_ACCESS_RELAXED_ORDERING && +pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));@@ -78,11 +79,9 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,MLX5_SET (mkc, mkc, lr,1 );if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write)) -MLX5_SET (mkc, mkc, relaxed_ordering_write, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_write, ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read)) -MLX5_SET (mkc, mkc, relaxed_ordering_read, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_read, ro_pci_enabled);
Quoted 7 lines
Quoted 4 lines
drivers/infiniband/hw/mlx5/mr.c +0
-0MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );(END)
Yes this looks good.
Can you/Avihai create a patch from this ? or I'll do it ?
I'd be surpised if it matters.. CSE and all
Jason
Quoted 84 lines · Jason Gunthorpe
Quoted 83 lines · Max Gurtovoy
Quoted 77 lines · Leon Romanovsky
Quoted 43 lines · Max Gurtovoy
Quoted 32 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +2
-0+++ b/drivers/infiniband/hw/mlx5/mr.c@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 84
Quoted 8 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);Jason,
Quoted 2 lines
If it's still possible to add small change, it will be nice to avoid calculating "acc &
IB_ACCESS_RELAXED_ORDERING&&ro_pci_enabled" twice.The patch is part of for-next now, so feel free to send followup patch.
Thanks
drivers/infiniband/hw/mlx5/mr.c +5
-5+++ b/drivers/infiniband/hw/mlx5/mr.c@@ -69,7 +69,8 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); -bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev); +bool ro_pci_enabled = acc &IB_ACCESS_RELAXED_ORDERING && +pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));@@ -78,11 +79,9 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,MLX5_SET (mkc, mkc, lr,1 );if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write)) -MLX5_SET (mkc, mkc, relaxed_ordering_write, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_write, ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read)) -MLX5_SET (mkc, mkc, relaxed_ordering_read, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_read, ro_pci_enabled);MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );Quoted 2 lines
(END)
Yes this looks good.
Quoted 3 lines
Quoted 1 line
Can you/Avihai create a patch from this ? or I'll do it ?
I'd be surpised if it matters.. CSE and all
From bytecode/performance POV, It shouldn't change anything. However it looks better.
Thanks
Quoted 2 lines
Jason
Quoted 81 lines · Max Gurtovoy
Quoted 79 lines · Leon Romanovsky
Quoted 46 lines · Max Gurtovoy
Quoted 35 lines · Leon Romanovsky
From: Avihai Horon <[email protected]>
Relaxed Ordering is a capability that can only benefit users that support it. All kernel ULPs should support Relaxed Ordering, as they are designed to read data only after observing the CQE and use the DMA API correctly.
Hence, implicitly enable Relaxed Ordering by default for kernel ULPs.
Signed-off-by Avihai Horon <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>---
Changelog:
v2:
* Dropped IB/core patch and set RO implicitly in mlx5 exactly like in eth side of mlx5 driver.
v1: https://lore.kernel.org/lkml/[email protected]
* Enabled by default RO in IB/core instead of changing all users
v0: https://lore.kernel.org/lkml/[email protected]--- drivers/infiniband/hw/mlx5/mr.c | 10 ++++++---- drivers/infiniband/hw/mlx5/wr.c | 5 ++++- 2 files changed, 10 insertions(+), 5 deletions(-)drivers/infiniband/hw/mlx5/mr.c +1
-0@@ -69,6 +69,7 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); +bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));drivers/infiniband/hw/mlx5/mr.c static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, · line 84
Quoted 8 lines
drivers/infiniband/hw/mlx5/mr.c +2
-2@@ -78,10 +79,10 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write))MLX5_SET (mkc, mkc, relaxed_ordering_write, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read))MLX5_SET (mkc, mkc, relaxed_ordering_read, - !!(acc &IB_ACCESS_RELAXED_ORDERING )); + acc &IB_ACCESS_RELAXED_ORDERING && ro_pci_enabled);Jason,
Quoted 2 lines
If it's still possible to add small change, it will be nice to avoid calculating "acc &
IB_ACCESS_RELAXED_ORDERING&&ro_pci_enabled" twice.The patch is part of for-next now, so feel free to send followup patch.
Thanks
drivers/infiniband/hw/mlx5/mr.c +4
-5@@ -69,7 +69,8 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr, struct ib_pd *pd) {struct mlx5_ib_dev *dev =to_mdev (pd->device); -bool ro_pci_enabled =pcie_relaxed_ordering_enabled (dev->mdev->pdev); +bool ro_pci_enabled = acc &IB_ACCESS_RELAXED_ORDERING && +pcie_relaxed_ordering_enabled (dev->mdev->pdev);MLX5_SET (mkc, mkc, a, !!(acc &IB_ACCESS_REMOTE_ATOMIC ));MLX5_SET (mkc, mkc, rw, !!(acc &IB_ACCESS_REMOTE_WRITE ));@@ -78,11 +79,9 @@ static void set_mkc_access_pd_addr_fields(void *mkc, int acc, u64 start_addr,MLX5_SET (mkc, mkc, lr,1 );if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_write)) -MLX5_SET (mkc, mkc, relaxed_ordering_write, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_write, ro_pci_enabled);if (MLX5_CAP_GEN (dev->mdev, relaxed_ordering_read)) -MLX5_SET (mkc, mkc, relaxed_ordering_read, - (acc &IB_ACCESS_RELAXED_ORDERING ) && ro_pci_enabled); +MLX5_SET (mkc, mkc, relaxed_ordering_read, ro_pci_enabled);
Quoted 7 lines
Quoted 4 lines
drivers/infiniband/hw/mlx5/mr.c +0
-0MLX5_SET (mkc, mkc, pd,to_mpd (pd)->pdn);MLX5_SET (mkc, mkc, qpn,0xffffff );(END)
Yes this looks good.
Can you/Avihai create a patch from this ? or I'll do it ?
Feel free to send it directly.
Thanks
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines