Evaluation of topology-aware broadcast algorithms for dragonfly networks

Matthieu Dorier, Misbah Mubarak, Rob Ross, Jianping Kelvin Li, Christopher D. Carothers, Kwan-Liu Ma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Two-tiered direct network topologies such as Dragonflies have been proposed for future post-petascale and exascale machines, since they provide a high-radix, low-diameter, fast interconnection network. Such topologies call for redesigning MPI collective communication algorithms in order to attain the best performance. Yet as increasingly more applications share a machine, it is not clear how these topology-aware algorithms will react to interference with concurrent jobs accessing the same network. In this paper, we study three topology-aware broadcast algorithms, including one designed by ourselves. We evaluate their performance through event-driven simulation for small- and large-sized broadcasts (in terms of both data size and number of processes). We study the effect of different routing mechanisms on the topology-aware collective algorithms, as well as their sensitivity to network contention with other jobs. Our results show that while topology-aware algorithms dramatically reduce link utilization, their advantage in terms of latency is more limited.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-49
Number of pages10
ISBN (Electronic)9781509036530
DOIs
StatePublished - Dec 6 2016
Event2016 IEEE International Conference on Cluster Computing, CLUSTER 2016 - Taipei, Taiwan, Province of China
Duration: Sep 13 2016Sep 15 2016

Other

Other2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
CountryTaiwan, Province of China
CityTaipei
Period9/13/169/15/16

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Signal Processing

Fingerprint Dive into the research topics of 'Evaluation of topology-aware broadcast algorithms for dragonfly networks'. Together they form a unique fingerprint.

  • Cite this

    Dorier, M., Mubarak, M., Ross, R., Li, J. K., Carothers, C. D., & Ma, K-L. (2016). Evaluation of topology-aware broadcast algorithms for dragonfly networks. In Proceedings - 2016 IEEE International Conference on Cluster Computing, CLUSTER 2016 (pp. 40-49). [7776477] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CLUSTER.2016.26