TY - GEN
T1 - Sonomyography Combined with Vibrotactile Feedback Enables Precise Target Acquisition Without Visual Feedback
AU - Patwardhan, Shriniwas
AU - Mukherjee, Biswarup
AU - Dhawan, Ananya
AU - Alzamani, Meena
AU - Noor, Abdul
AU - Engdahl, Susannah
AU - Joiner, Wilsaan M.
AU - Sikdar, Siddhartha
N1 - Publisher Copyright:
© 2020 IEEE.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2020/7
Y1 - 2020/7
N2 - Upper limb prosthesis users currently lack haptic feedback from their terminal devices, which significantly limits their ability to meaningfully interact with their environment. Users therefore rely heavily on visual feedback when using terminal devices. Previously, it has been shown that force-related feedback from an end-effector or virtual environment can help the user minimize errors and improve performance. Currently, myoelectric control systems enable the user to control the velocity of terminal devices. We have developed a novel control method using ultrasound sensing, called sonomyography, that enables position control based on mechanical deformation of muscles. In this paper, we investigated whether the proprioceptive feedback from muscle deformation combined with vibrotactile haptic feedback can minimize the need for visual feedback. Able bodied subjects used sonomyography to control a virtual cursor, and performed a target acquisition task. The effect of visual and haptic feedback on performance of a target acquisition task was systematically tested. We found that subjects made large errors when they tried to reacquire a target without visual feedback, but in the presence of real-time haptic feedback, the precision of the target position improved, and were similar to when visual feedback was used for target acquisition. This result has implications for improving the performance of prosthetic control systems.
AB - Upper limb prosthesis users currently lack haptic feedback from their terminal devices, which significantly limits their ability to meaningfully interact with their environment. Users therefore rely heavily on visual feedback when using terminal devices. Previously, it has been shown that force-related feedback from an end-effector or virtual environment can help the user minimize errors and improve performance. Currently, myoelectric control systems enable the user to control the velocity of terminal devices. We have developed a novel control method using ultrasound sensing, called sonomyography, that enables position control based on mechanical deformation of muscles. In this paper, we investigated whether the proprioceptive feedback from muscle deformation combined with vibrotactile haptic feedback can minimize the need for visual feedback. Able bodied subjects used sonomyography to control a virtual cursor, and performed a target acquisition task. The effect of visual and haptic feedback on performance of a target acquisition task was systematically tested. We found that subjects made large errors when they tried to reacquire a target without visual feedback, but in the presence of real-time haptic feedback, the precision of the target position improved, and were similar to when visual feedback was used for target acquisition. This result has implications for improving the performance of prosthetic control systems.
UR - http://www.scopus.com/inward/record.url?scp=85091021473&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85091021473&partnerID=8YFLogxK
U2 - 10.1109/EMBC44109.2020.9176524
DO - 10.1109/EMBC44109.2020.9176524
M3 - Conference contribution
AN - SCOPUS:85091021473
T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
SP - 4955
EP - 4958
BT - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
Y2 - 20 July 2020 through 24 July 2020
ER -