Evaluation of topology-aware broadcast algorithms for dragonfly networks

Matthieu Dorier, Misbah Mubarak, Rob Ross, Jianping Kelvin Li, Christopher D. Carothers, Kwan-Liu Ma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Two-tiered direct network topologies such as Dragonflies have been proposed for future post-petascale and exascale machines, since they provide a high-radix, low-diameter, fast interconnection network. Such topologies call for redesigning MPI collective communication algorithms in order to attain the best performance. Yet as increasingly more applications share a machine, it is not clear how these topology-aware algorithms will react to interference with concurrent jobs accessing the same network. In this paper, we study three topology-aware broadcast algorithms, including one designed by ourselves. We evaluate their performance through event-driven simulation for small- and large-sized broadcasts (in terms of both data size and number of processes). We study the effect of different routing mechanisms on the topology-aware collective algorithms, as well as their sensitivity to network contention with other jobs. Our results show that while topology-aware algorithms dramatically reduce link utilization, their advantage in terms of latency is more limited.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-49
Number of pages10
ISBN (Electronic)9781509036530
DOIs
StatePublished - Dec 6 2016
Event2016 IEEE International Conference on Cluster Computing, CLUSTER 2016 - Taipei, Taiwan, Province of China
Duration: Sep 13 2016Sep 15 2016

Other

Other2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
Country/TerritoryTaiwan, Province of China
CityTaipei
Period9/13/169/15/16

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Signal Processing

Fingerprint

Dive into the research topics of 'Evaluation of topology-aware broadcast algorithms for dragonfly networks'. Together they form a unique fingerprint.

Cite this