Subjective Assessment of Videofluoroscopic Swallow Studies

Janet W. Lee, Derrick R. Randall, Lisa M. Evangelista, Maggie Kuhn, Peter C Belafsky

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Objective: The videofluoroscopic swallow study (VFSS) is the gold standard diagnostic tool to evaluate oropharyngeal dysphagia. Although objective measurements on VFSS have been described, there is no universal method of analysis, and the majority of clinicians use subjective interpretation alone. The purpose of this investigation was to evaluate the accuracy of subjective VFSS analysis. Study Design: Double-blinded experiment. Setting: Tertiary care laryngology center. Subjects and Methods: Seventy-six de-identified videos from VFSS evaluations of patients with dysphagia were presented to blinded, experienced speech-language pathologists and laryngologists individually. Evaluators rated each video as normal or abnormal for hyoid elevation (HE), pharyngeal area (PA), pharyngeal constriction ratio (PCR), and pharyngoesophageal segment opening (PESo). A blinded investigator assessed evaluators’ inter- and intrarater agreement and compared their responses to objectively measured results for these parameters to examine accuracy. Results: Evaluators correctly classified only 61.5% of VFSS videos as normal or abnormal, with moderate interrater agreement (κ = 0.48, P <.0001). Intrarater agreement was highly variable (κ = 0.43-0.83). Accuracy was greatest for PCR (71.6%), with poorer performance for HE (61.3%), PESo (59.2%), and PA (45.3%). Interrater agreement was moderate for all parameters, with greater concordance for PCR (κ = 0.59) and PESo (κ = 0.54) and less for HE (κ = 0.40) and PA (κ = 0.44). Evaluators unanimously agreed on a correct interpretation of a VFSS only 28% of the time. Conclusion: Subjective assessment of VFSS parameters is inconsistently accurate when compared with objective measurements, with accuracy ratings ranging from 45.3% to 71.6% for specific parameters. Inter- and intrarater reliability for subjective assessment was moderate and highly variable.

Original languageEnglish (US)
Pages (from-to)901-905
Number of pages5
JournalOtolaryngology - Head and Neck Surgery (United States)
Volume156
Issue number5
DOIs
StatePublished - May 1 2017

Fingerprint

Swallows
Deglutition
Constriction
Deglutition Disorders
Otolaryngology
Tertiary Care Centers
Language
Research Personnel

Keywords

  • deglutition
  • dynamic swallow study
  • dysphagia
  • fluoroscopic swallow study
  • MBS
  • modified barium swallow
  • objective measures
  • pharynx
  • reproducibility
  • VFSS

ASJC Scopus subject areas

  • Surgery
  • Otorhinolaryngology

Cite this

Subjective Assessment of Videofluoroscopic Swallow Studies. / Lee, Janet W.; Randall, Derrick R.; Evangelista, Lisa M.; Kuhn, Maggie; Belafsky, Peter C.

In: Otolaryngology - Head and Neck Surgery (United States), Vol. 156, No. 5, 01.05.2017, p. 901-905.

Research output: Contribution to journalArticle

Lee, Janet W. ; Randall, Derrick R. ; Evangelista, Lisa M. ; Kuhn, Maggie ; Belafsky, Peter C. / Subjective Assessment of Videofluoroscopic Swallow Studies. In: Otolaryngology - Head and Neck Surgery (United States). 2017 ; Vol. 156, No. 5. pp. 901-905.
@article{4759a89bb7534b4c94d29e40c8d7ddf5,
title = "Subjective Assessment of Videofluoroscopic Swallow Studies",
abstract = "Objective: The videofluoroscopic swallow study (VFSS) is the gold standard diagnostic tool to evaluate oropharyngeal dysphagia. Although objective measurements on VFSS have been described, there is no universal method of analysis, and the majority of clinicians use subjective interpretation alone. The purpose of this investigation was to evaluate the accuracy of subjective VFSS analysis. Study Design: Double-blinded experiment. Setting: Tertiary care laryngology center. Subjects and Methods: Seventy-six de-identified videos from VFSS evaluations of patients with dysphagia were presented to blinded, experienced speech-language pathologists and laryngologists individually. Evaluators rated each video as normal or abnormal for hyoid elevation (HE), pharyngeal area (PA), pharyngeal constriction ratio (PCR), and pharyngoesophageal segment opening (PESo). A blinded investigator assessed evaluators’ inter- and intrarater agreement and compared their responses to objectively measured results for these parameters to examine accuracy. Results: Evaluators correctly classified only 61.5{\%} of VFSS videos as normal or abnormal, with moderate interrater agreement (κ = 0.48, P <.0001). Intrarater agreement was highly variable (κ = 0.43-0.83). Accuracy was greatest for PCR (71.6{\%}), with poorer performance for HE (61.3{\%}), PESo (59.2{\%}), and PA (45.3{\%}). Interrater agreement was moderate for all parameters, with greater concordance for PCR (κ = 0.59) and PESo (κ = 0.54) and less for HE (κ = 0.40) and PA (κ = 0.44). Evaluators unanimously agreed on a correct interpretation of a VFSS only 28{\%} of the time. Conclusion: Subjective assessment of VFSS parameters is inconsistently accurate when compared with objective measurements, with accuracy ratings ranging from 45.3{\%} to 71.6{\%} for specific parameters. Inter- and intrarater reliability for subjective assessment was moderate and highly variable.",
keywords = "deglutition, dynamic swallow study, dysphagia, fluoroscopic swallow study, MBS, modified barium swallow, objective measures, pharynx, reproducibility, VFSS",
author = "Lee, {Janet W.} and Randall, {Derrick R.} and Evangelista, {Lisa M.} and Maggie Kuhn and Belafsky, {Peter C}",
year = "2017",
month = "5",
day = "1",
doi = "10.1177/0194599817691276",
language = "English (US)",
volume = "156",
pages = "901--905",
journal = "Otolaryngology - Head and Neck Surgery (United States)",
issn = "0194-5998",
publisher = "Mosby Inc.",
number = "5",

}

TY - JOUR

T1 - Subjective Assessment of Videofluoroscopic Swallow Studies

AU - Lee, Janet W.

AU - Randall, Derrick R.

AU - Evangelista, Lisa M.

AU - Kuhn, Maggie

AU - Belafsky, Peter C

PY - 2017/5/1

Y1 - 2017/5/1

N2 - Objective: The videofluoroscopic swallow study (VFSS) is the gold standard diagnostic tool to evaluate oropharyngeal dysphagia. Although objective measurements on VFSS have been described, there is no universal method of analysis, and the majority of clinicians use subjective interpretation alone. The purpose of this investigation was to evaluate the accuracy of subjective VFSS analysis. Study Design: Double-blinded experiment. Setting: Tertiary care laryngology center. Subjects and Methods: Seventy-six de-identified videos from VFSS evaluations of patients with dysphagia were presented to blinded, experienced speech-language pathologists and laryngologists individually. Evaluators rated each video as normal or abnormal for hyoid elevation (HE), pharyngeal area (PA), pharyngeal constriction ratio (PCR), and pharyngoesophageal segment opening (PESo). A blinded investigator assessed evaluators’ inter- and intrarater agreement and compared their responses to objectively measured results for these parameters to examine accuracy. Results: Evaluators correctly classified only 61.5% of VFSS videos as normal or abnormal, with moderate interrater agreement (κ = 0.48, P <.0001). Intrarater agreement was highly variable (κ = 0.43-0.83). Accuracy was greatest for PCR (71.6%), with poorer performance for HE (61.3%), PESo (59.2%), and PA (45.3%). Interrater agreement was moderate for all parameters, with greater concordance for PCR (κ = 0.59) and PESo (κ = 0.54) and less for HE (κ = 0.40) and PA (κ = 0.44). Evaluators unanimously agreed on a correct interpretation of a VFSS only 28% of the time. Conclusion: Subjective assessment of VFSS parameters is inconsistently accurate when compared with objective measurements, with accuracy ratings ranging from 45.3% to 71.6% for specific parameters. Inter- and intrarater reliability for subjective assessment was moderate and highly variable.

AB - Objective: The videofluoroscopic swallow study (VFSS) is the gold standard diagnostic tool to evaluate oropharyngeal dysphagia. Although objective measurements on VFSS have been described, there is no universal method of analysis, and the majority of clinicians use subjective interpretation alone. The purpose of this investigation was to evaluate the accuracy of subjective VFSS analysis. Study Design: Double-blinded experiment. Setting: Tertiary care laryngology center. Subjects and Methods: Seventy-six de-identified videos from VFSS evaluations of patients with dysphagia were presented to blinded, experienced speech-language pathologists and laryngologists individually. Evaluators rated each video as normal or abnormal for hyoid elevation (HE), pharyngeal area (PA), pharyngeal constriction ratio (PCR), and pharyngoesophageal segment opening (PESo). A blinded investigator assessed evaluators’ inter- and intrarater agreement and compared their responses to objectively measured results for these parameters to examine accuracy. Results: Evaluators correctly classified only 61.5% of VFSS videos as normal or abnormal, with moderate interrater agreement (κ = 0.48, P <.0001). Intrarater agreement was highly variable (κ = 0.43-0.83). Accuracy was greatest for PCR (71.6%), with poorer performance for HE (61.3%), PESo (59.2%), and PA (45.3%). Interrater agreement was moderate for all parameters, with greater concordance for PCR (κ = 0.59) and PESo (κ = 0.54) and less for HE (κ = 0.40) and PA (κ = 0.44). Evaluators unanimously agreed on a correct interpretation of a VFSS only 28% of the time. Conclusion: Subjective assessment of VFSS parameters is inconsistently accurate when compared with objective measurements, with accuracy ratings ranging from 45.3% to 71.6% for specific parameters. Inter- and intrarater reliability for subjective assessment was moderate and highly variable.

KW - deglutition

KW - dynamic swallow study

KW - dysphagia

KW - fluoroscopic swallow study

KW - MBS

KW - modified barium swallow

KW - objective measures

KW - pharynx

KW - reproducibility

KW - VFSS

UR - http://www.scopus.com/inward/record.url?scp=85018775027&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018775027&partnerID=8YFLogxK

U2 - 10.1177/0194599817691276

DO - 10.1177/0194599817691276

M3 - Article

VL - 156

SP - 901

EP - 905

JO - Otolaryngology - Head and Neck Surgery (United States)

JF - Otolaryngology - Head and Neck Surgery (United States)

SN - 0194-5998

IS - 5

ER -