Abstract
Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.
| Original language | English (US) |
|---|---|
| Title of host publication | Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018 |
| Publisher | IEEE Computer Society |
| Pages | 225-229 |
| Number of pages | 5 |
| Volume | 2018-April |
| ISBN (Electronic) | 9781538614242 |
| DOIs | |
| State | Published - May 25 2018 |
| Event | 11th IEEE Pacific Visualization Symposium, PacificVis 2018 - Kobe, Japan Duration: Apr 10 2018 → Apr 13 2018 |
Other
| Other | 11th IEEE Pacific Visualization Symposium, PacificVis 2018 |
|---|---|
| Country | Japan |
| City | Kobe |
| Period | 4/10/18 → 4/13/18 |
Fingerprint
Keywords
- engagement
- sound-augmented visualization
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design
- Computer Vision and Pattern Recognition
- Hardware and Architecture
- Software
Cite this
Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement. / Du, Meng; Chou, Jia Kai; Ma, Chen; Chandrasegaran, Senthil; Ma, Kwan-Liu.
Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018. Vol. 2018-April IEEE Computer Society, 2018. p. 225-229.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Exploring the Role of Sound in Augmenting Visualization to Enhance User Engagement
AU - Du, Meng
AU - Chou, Jia Kai
AU - Ma, Chen
AU - Chandrasegaran, Senthil
AU - Ma, Kwan-Liu
PY - 2018/5/25
Y1 - 2018/5/25
N2 - Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.
AB - Studies on augmenting visualization with sound are typically based on the assumption that sound can be complementary and assist in data analysis tasks. While sound promotes a different sense of engagement than vision, we conjecture that by augmenting non-speech audio to a visualization can not only help enhance the users' perception of the data but also increase their engagement with the data exploration process. We have designed a preliminary user study to test users' performance and engagement while exploring in a data visualization system under two different settings: visual-only and audiovisual. For our study, we used basketball player movement data in a game and created an interactive visualization system with three linked views. We supplemented sound to the visualization to enhance the users' understanding of a team's offensive/defensive behavior. The results of our study suggest that we need to better understand the effect of sound choice and encoding before considering engagement. We also find that sound can be useful to draw novice users' attention to patterns or anomalies in the data. Finally, we propose follow-up studies with designs informed by the findings from this study.
KW - engagement
KW - sound-augmented visualization
UR - http://www.scopus.com/inward/record.url?scp=85048293284&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85048293284&partnerID=8YFLogxK
U2 - 10.1109/PacificVis.2018.00036
DO - 10.1109/PacificVis.2018.00036
M3 - Conference contribution
AN - SCOPUS:85048293284
VL - 2018-April
SP - 225
EP - 229
BT - Proceedings - 2018 IEEE Pacific Visualization Symposium, PacificVis 2018
PB - IEEE Computer Society
ER -