Real-time human pose detection and tracking for tele-rehabilitation in virtual reality

Štěpán Obdržálek, Gregorij Kurillo, Jay Han, Ted Abresch, Ruzena Bajcsy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

We present a real-time algorithm for human pose detection and tracking from vision-based 3D data and its application to tele-rehabilitation in virtual environments. We employ stereo camera(s) to capture 3D avatars of geographically dislocated patient and therapist in real-time, while sending the data remotely and displaying it in a virtual scene. A pose detection and tracking algorithm extracts kinematic parameters from each participant and determines pose similarity. The pose similarity score is used to quantify patient's performance and provide real-time feedback for remote rehabilitation.

Original languageEnglish (US)
Title of host publicationStudies in Health Technology and Informatics
Pages320-324
Number of pages5
Volume173
DOIs
StatePublished - 2012
EventMedicine Meets Virtual Reality 19: NextMed, MMVR 2012 - Newport Beach, CA, United States
Duration: Feb 9 2012Feb 11 2012

Other

OtherMedicine Meets Virtual Reality 19: NextMed, MMVR 2012
CountryUnited States
CityNewport Beach, CA
Period2/9/122/11/12

Fingerprint

Patient rehabilitation
Virtual reality
Kinematics
Cameras
Feedback
Biomechanical Phenomena
Telerehabilitation

Keywords

  • Human pose estimation and tracking
  • Stereo vision
  • Tele-rehabilitation

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

Obdržálek, Š., Kurillo, G., Han, J., Abresch, T., & Bajcsy, R. (2012). Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. In Studies in Health Technology and Informatics (Vol. 173, pp. 320-324) https://doi.org/10.3233/978-1-61499-022-2-320

Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. / Obdržálek, Štěpán; Kurillo, Gregorij; Han, Jay; Abresch, Ted; Bajcsy, Ruzena.

Studies in Health Technology and Informatics. Vol. 173 2012. p. 320-324.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Obdržálek, Š, Kurillo, G, Han, J, Abresch, T & Bajcsy, R 2012, Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. in Studies in Health Technology and Informatics. vol. 173, pp. 320-324, Medicine Meets Virtual Reality 19: NextMed, MMVR 2012, Newport Beach, CA, United States, 2/9/12. https://doi.org/10.3233/978-1-61499-022-2-320
Obdržálek Š, Kurillo G, Han J, Abresch T, Bajcsy R. Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. In Studies in Health Technology and Informatics. Vol. 173. 2012. p. 320-324 https://doi.org/10.3233/978-1-61499-022-2-320
Obdržálek, Štěpán ; Kurillo, Gregorij ; Han, Jay ; Abresch, Ted ; Bajcsy, Ruzena. / Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. Studies in Health Technology and Informatics. Vol. 173 2012. pp. 320-324
@inproceedings{385ba75e5acd4edcb616b5e7f35662cf,
title = "Real-time human pose detection and tracking for tele-rehabilitation in virtual reality",
abstract = "We present a real-time algorithm for human pose detection and tracking from vision-based 3D data and its application to tele-rehabilitation in virtual environments. We employ stereo camera(s) to capture 3D avatars of geographically dislocated patient and therapist in real-time, while sending the data remotely and displaying it in a virtual scene. A pose detection and tracking algorithm extracts kinematic parameters from each participant and determines pose similarity. The pose similarity score is used to quantify patient's performance and provide real-time feedback for remote rehabilitation.",
keywords = "Human pose estimation and tracking, Stereo vision, Tele-rehabilitation",
author = "Štěp{\'a}n Obdrž{\'a}lek and Gregorij Kurillo and Jay Han and Ted Abresch and Ruzena Bajcsy",
year = "2012",
doi = "10.3233/978-1-61499-022-2-320",
language = "English (US)",
isbn = "9781614990215",
volume = "173",
pages = "320--324",
booktitle = "Studies in Health Technology and Informatics",

}

TY - GEN

T1 - Real-time human pose detection and tracking for tele-rehabilitation in virtual reality

AU - Obdržálek, Štěpán

AU - Kurillo, Gregorij

AU - Han, Jay

AU - Abresch, Ted

AU - Bajcsy, Ruzena

PY - 2012

Y1 - 2012

N2 - We present a real-time algorithm for human pose detection and tracking from vision-based 3D data and its application to tele-rehabilitation in virtual environments. We employ stereo camera(s) to capture 3D avatars of geographically dislocated patient and therapist in real-time, while sending the data remotely and displaying it in a virtual scene. A pose detection and tracking algorithm extracts kinematic parameters from each participant and determines pose similarity. The pose similarity score is used to quantify patient's performance and provide real-time feedback for remote rehabilitation.

AB - We present a real-time algorithm for human pose detection and tracking from vision-based 3D data and its application to tele-rehabilitation in virtual environments. We employ stereo camera(s) to capture 3D avatars of geographically dislocated patient and therapist in real-time, while sending the data remotely and displaying it in a virtual scene. A pose detection and tracking algorithm extracts kinematic parameters from each participant and determines pose similarity. The pose similarity score is used to quantify patient's performance and provide real-time feedback for remote rehabilitation.

KW - Human pose estimation and tracking

KW - Stereo vision

KW - Tele-rehabilitation

UR - http://www.scopus.com/inward/record.url?scp=84860645603&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860645603&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-022-2-320

DO - 10.3233/978-1-61499-022-2-320

M3 - Conference contribution

SN - 9781614990215

VL - 173

SP - 320

EP - 324

BT - Studies in Health Technology and Informatics

ER -