Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement

Meng Du, Jia Kai Chou, Chen Ma, Senthil Chandrasegaran, Kwan-Liu Ma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018
PublisherIEEE Computer Society
Pages225-229
Number of pages5
Volume2018-April
ISBN (Electronic)9781538614242
DOIs
StatePublished - May 25 2018
Event11th IEEE Pacific Visualization Symposium, PacificVis 2018 - Kobe, Japan
Duration: Apr 10 2018Apr 13 2018

Other

Other11th IEEE Pacific Visualization Symposium, PacificVis 2018
CountryJapan
CityKobe
Period4/10/184/13/18

Fingerprint

Visualization
Acoustic waves
Data visualization

Keywords

  • engagement
  • sound-augmented visualization

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Software

Cite this

Du, M., Chou, J. K., Ma, C., Chandrasegaran, S., & Ma, K-L. (2018). Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. In Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018 (Vol. 2018-April, pp. 225-229). IEEE Computer Society. https://doi.org/10.1109/PacificVis.2018.00036

Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. / Du, Meng; Chou, Jia Kai; Ma, Chen; Chandrasegaran, Senthil; Ma, Kwan-Liu.

Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018. Vol. 2018-April IEEE Computer Society, 2018. p. 225-229.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Du, M, Chou, JK, Ma, C, Chandrasegaran, S & Ma, K-L 2018, Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. in Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018. vol. 2018-April, IEEE Computer Society, pp. 225-229, 11th IEEE Pacific Visualization Symposium, PacificVis 2018, Kobe, Japan, 4/10/18. https://doi.org/10.1109/PacificVis.2018.00036
Du M, Chou JK, Ma C, Chandrasegaran S, Ma K-L. Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. In Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018. Vol. 2018-April. IEEE Computer Society. 2018. p. 225-229 https://doi.org/10.1109/PacificVis.2018.00036
Du, Meng ; Chou, Jia Kai ; Ma, Chen ; Chandrasegaran, Senthil ; Ma, Kwan-Liu. / Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018. Vol. 2018-April IEEE Computer Society, 2018. pp. 225-229
@inproceedings{03d6d6d6c47840949f3a7bb551f57905,
title = "Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement",
abstract = "Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.",
keywords = "engagement, sound-augmented visualization",
author = "Meng Du and Chou, {Jia Kai} and Chen Ma and Senthil Chandrasegaran and Kwan-Liu Ma",
year = "2018",
month = "5",
day = "25",
doi = "10.1109/PacificVis.2018.00036",
language = "English (US)",
volume = "2018-April",
pages = "225--229",
booktitle = "Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement

AU - Du, Meng

AU - Chou, Jia Kai

AU - Ma, Chen

AU - Chandrasegaran, Senthil

AU - Ma, Kwan-Liu

PY - 2018/5/25

Y1 - 2018/5/25

N2 - Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.

AB - Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.

KW - engagement

KW - sound-augmented visualization

UR - http://www.scopus.com/inward/record.url?scp=85048293284&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048293284&partnerID=8YFLogxK

U2 - 10.1109/PacificVis.2018.00036

DO - 10.1109/PacificVis.2018.00036

M3 - Conference contribution

AN - SCOPUS:85048293284

VL - 2018-April

SP - 225

EP - 229

BT - Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018

PB - IEEE Computer Society

ER -