Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement

Meng Du, Jia Kai Chou, Chen Ma, Senthil Chandrasegaran, Kwan-Liu Ma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018
PublisherIEEE Computer Society
Pages225-229
Number of pages5
Volume2018-April
ISBN (Electronic)9781538614242
DOIs
StatePublished - May 25 2018
Event11th IEEE Pacific Visualization Symposium, PacificVis 2018 - Kobe, Japan
Duration: Apr 10 2018Apr 13 2018

Other

Other11th IEEE Pacific Visualization Symposium, PacificVis 2018
CountryJapan
CityKobe
Period4/10/184/13/18

Keywords

  • engagement
  • sound-augmented visualization

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement'. Together they form a unique fingerprint.

  • Cite this

    Du, M., Chou, J. K., Ma, C., Chandrasegaran, S., & Ma, K-L. (2018). Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. In Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018 (Vol. 2018-April, pp. 225-229). IEEE Computer Society. https://doi.org/10.1109/PacificVis.2018.00036