Skip to content

opensm: dump PathRecords file

Yevgeny Kliteynik linux-rdma 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest4 patches 2 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/4opensm: added function that dumps PathRecordsopensm/include/opensm/osm_sa.h opensm/opensm/osm_sa.c opensm/opensm/osm_sa_path_record.c+114 -02 replies
2/4opensm: added 2 options: dump PRs and filenameopensm/include/opensm/osm_subnet.h opensm/opensm/osm_subnet.c+24 -00 replies
3/4opensm: dump PRs after every heavy sweep and after rerouteopensm/opensm/osm_dump.c opensm/opensm/osm_state_mgr.c+5 -00 replies
4/4opensm: add command line argument to dump PR fileopensm/man/opensm.8.in opensm/opensm/main.c+16 -10 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 0/4] opensm: dump PathRecords file

Hi Sasha,

One of the major bottlenecks of the OpenSM is handling SA queries storm. In order to allow all-2-all communication, SA must process N^2 PathRecord queries.
On large clusters this takes way too much time.

Currently, most of the MPI implementations do not query SA at all in order to avoid this problem, but use predefined parameters when communicating between fabric nodes.

This works fine as long as MPI doesn't need to use different parameters for different path, but it's a problem when we're talking about non-trivial QoS settings or routing engines that are using IB VLs (such as Torus-2QoS).

The following patch series enables OpenSM to dump core information from PathRecords that is needed for opening communication channel: SL, MTU and Rate.

This information is dumped for for all the non-switch-2-non-switch paths in the subnet in the following way:

for every non-switch source port
for every non-switch target LID in the subnet
dump PR between source port and target LID

This way number of sources is equal to number of physical non-switch ports in the subnet, and only number of targets depends on LMC that is used.

Patches:

[PATCH 1/4] opensm: added function that dumps PathRecords [PATCH 2/4] opensm: added 2 options: dump PRs and filename [PATCH 3/4] opensm: dump PRs after every heavy sweep and
after reroute
[PATCH 4/4] opensm: add command line argument to dump PR file

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html