Interobserver agreement in retrospective chart reviews for factors associated with cervical spine injuries in children

Cody S. Olsen, Nathan Kuppermann, David M. Jaffe, Kathleen Brown, Lynn Babcock, Prashant V. Mahajan, Julie C. Leonard

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Objectives The objective was to describe the interobserver agreement between trained chart reviewers and physician reviewers in a multicenter retrospective chart review study of children with cervical spine injuries (CSIs). Methods Medical records of children younger than 16 years old with cervical spine radiography from 17 Pediatric Emergency Care Applied Research Network (PECARN) hospitals from years 2000 through 2004 were abstracted by trained reviewers for a study aimed to identify predictors of CSIs in children. Independent physician-reviewers abstracted patient history and clinical findings from a random sample of study patient medical records at each hospital. Interobserver agreement was assessed using percent agreement and the weighted kappa (κ) statistic, with lower 95% confidence intervals. Results Moderate or better agreement (κ > 0.4) was achieved for most candidate CSI predictors, including altered mental status (κ = 0.87); focal neurologic findings (κ = 0.74); posterior midline neck tenderness (κ = 0.74); any neck tenderness (κ = 0.89); torticollis (κ = 0.79); complaint of neck pain (κ = 0.83); history of loss of consciousness (κ = 0.89); nonambulatory status (κ = 0.74); and substantial injuries to the head (κ = 0.50), torso/trunk (κ = 0.48), and extremities (κ = 0.59). High-risk mechanisms showed near-perfect agreement (diving, κ = 1.0; struck by car, κ = 0.93; other motorized vehicle crash, κ = 0.93; fall, κ = 0.92; high-risk motor vehicle collision, κ = 0.89; hanging, κ = 0.80). Fair agreement was found for clotheslining mechanisms (κ = 0.36) and substantial face injuries (κ = 0.40). Conclusions Most retrospectively assessed variables thought to be predictive of CSIs in blunt trauma-injured children had at least moderate interobserver agreement, suggesting that these data are sufficiently valid for use in identifying potential predictors of CSI.

Original languageEnglish (US)
Pages (from-to)487-491
Number of pages5
JournalAcademic Emergency Medicine
Volume22
Issue number4
DOIs
StatePublished - Apr 1 2015

Fingerprint

Spine
Wounds and Injuries
Medical Records
Neck
Physicians
Torticollis
Torso
Diving
Nonpenetrating Wounds
Unconsciousness
Neck Pain
Emergency Medical Services
Motor Vehicles
Neurologic Manifestations
Craniocerebral Trauma
Radiography
Extremities
Confidence Intervals
Pediatrics
Research

ASJC Scopus subject areas

  • Emergency Medicine

Cite this

Interobserver agreement in retrospective chart reviews for factors associated with cervical spine injuries in children. / Olsen, Cody S.; Kuppermann, Nathan; Jaffe, David M.; Brown, Kathleen; Babcock, Lynn; Mahajan, Prashant V.; Leonard, Julie C.

In: Academic Emergency Medicine, Vol. 22, No. 4, 01.04.2015, p. 487-491.

Research output: Contribution to journalArticle

Olsen, Cody S. ; Kuppermann, Nathan ; Jaffe, David M. ; Brown, Kathleen ; Babcock, Lynn ; Mahajan, Prashant V. ; Leonard, Julie C. / Interobserver agreement in retrospective chart reviews for factors associated with cervical spine injuries in children. In: Academic Emergency Medicine. 2015 ; Vol. 22, No. 4. pp. 487-491.
@article{bfefe3b9fc844cb78069dc7954639ca9,
title = "Interobserver agreement in retrospective chart reviews for factors associated with cervical spine injuries in children",
abstract = "Objectives The objective was to describe the interobserver agreement between trained chart reviewers and physician reviewers in a multicenter retrospective chart review study of children with cervical spine injuries (CSIs). Methods Medical records of children younger than 16 years old with cervical spine radiography from 17 Pediatric Emergency Care Applied Research Network (PECARN) hospitals from years 2000 through 2004 were abstracted by trained reviewers for a study aimed to identify predictors of CSIs in children. Independent physician-reviewers abstracted patient history and clinical findings from a random sample of study patient medical records at each hospital. Interobserver agreement was assessed using percent agreement and the weighted kappa (κ) statistic, with lower 95{\%} confidence intervals. Results Moderate or better agreement (κ > 0.4) was achieved for most candidate CSI predictors, including altered mental status (κ = 0.87); focal neurologic findings (κ = 0.74); posterior midline neck tenderness (κ = 0.74); any neck tenderness (κ = 0.89); torticollis (κ = 0.79); complaint of neck pain (κ = 0.83); history of loss of consciousness (κ = 0.89); nonambulatory status (κ = 0.74); and substantial injuries to the head (κ = 0.50), torso/trunk (κ = 0.48), and extremities (κ = 0.59). High-risk mechanisms showed near-perfect agreement (diving, κ = 1.0; struck by car, κ = 0.93; other motorized vehicle crash, κ = 0.93; fall, κ = 0.92; high-risk motor vehicle collision, κ = 0.89; hanging, κ = 0.80). Fair agreement was found for clotheslining mechanisms (κ = 0.36) and substantial face injuries (κ = 0.40). Conclusions Most retrospectively assessed variables thought to be predictive of CSIs in blunt trauma-injured children had at least moderate interobserver agreement, suggesting that these data are sufficiently valid for use in identifying potential predictors of CSI.",
author = "Olsen, {Cody S.} and Nathan Kuppermann and Jaffe, {David M.} and Kathleen Brown and Lynn Babcock and Mahajan, {Prashant V.} and Leonard, {Julie C.}",
year = "2015",
month = "4",
day = "1",
doi = "10.1111/acem.12630",
language = "English (US)",
volume = "22",
pages = "487--491",
journal = "Academic Emergency Medicine",
issn = "1069-6563",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - Interobserver agreement in retrospective chart reviews for factors associated with cervical spine injuries in children

AU - Olsen, Cody S.

AU - Kuppermann, Nathan

AU - Jaffe, David M.

AU - Brown, Kathleen

AU - Babcock, Lynn

AU - Mahajan, Prashant V.

AU - Leonard, Julie C.

PY - 2015/4/1

Y1 - 2015/4/1

N2 - Objectives The objective was to describe the interobserver agreement between trained chart reviewers and physician reviewers in a multicenter retrospective chart review study of children with cervical spine injuries (CSIs). Methods Medical records of children younger than 16 years old with cervical spine radiography from 17 Pediatric Emergency Care Applied Research Network (PECARN) hospitals from years 2000 through 2004 were abstracted by trained reviewers for a study aimed to identify predictors of CSIs in children. Independent physician-reviewers abstracted patient history and clinical findings from a random sample of study patient medical records at each hospital. Interobserver agreement was assessed using percent agreement and the weighted kappa (κ) statistic, with lower 95% confidence intervals. Results Moderate or better agreement (κ > 0.4) was achieved for most candidate CSI predictors, including altered mental status (κ = 0.87); focal neurologic findings (κ = 0.74); posterior midline neck tenderness (κ = 0.74); any neck tenderness (κ = 0.89); torticollis (κ = 0.79); complaint of neck pain (κ = 0.83); history of loss of consciousness (κ = 0.89); nonambulatory status (κ = 0.74); and substantial injuries to the head (κ = 0.50), torso/trunk (κ = 0.48), and extremities (κ = 0.59). High-risk mechanisms showed near-perfect agreement (diving, κ = 1.0; struck by car, κ = 0.93; other motorized vehicle crash, κ = 0.93; fall, κ = 0.92; high-risk motor vehicle collision, κ = 0.89; hanging, κ = 0.80). Fair agreement was found for clotheslining mechanisms (κ = 0.36) and substantial face injuries (κ = 0.40). Conclusions Most retrospectively assessed variables thought to be predictive of CSIs in blunt trauma-injured children had at least moderate interobserver agreement, suggesting that these data are sufficiently valid for use in identifying potential predictors of CSI.

AB - Objectives The objective was to describe the interobserver agreement between trained chart reviewers and physician reviewers in a multicenter retrospective chart review study of children with cervical spine injuries (CSIs). Methods Medical records of children younger than 16 years old with cervical spine radiography from 17 Pediatric Emergency Care Applied Research Network (PECARN) hospitals from years 2000 through 2004 were abstracted by trained reviewers for a study aimed to identify predictors of CSIs in children. Independent physician-reviewers abstracted patient history and clinical findings from a random sample of study patient medical records at each hospital. Interobserver agreement was assessed using percent agreement and the weighted kappa (κ) statistic, with lower 95% confidence intervals. Results Moderate or better agreement (κ > 0.4) was achieved for most candidate CSI predictors, including altered mental status (κ = 0.87); focal neurologic findings (κ = 0.74); posterior midline neck tenderness (κ = 0.74); any neck tenderness (κ = 0.89); torticollis (κ = 0.79); complaint of neck pain (κ = 0.83); history of loss of consciousness (κ = 0.89); nonambulatory status (κ = 0.74); and substantial injuries to the head (κ = 0.50), torso/trunk (κ = 0.48), and extremities (κ = 0.59). High-risk mechanisms showed near-perfect agreement (diving, κ = 1.0; struck by car, κ = 0.93; other motorized vehicle crash, κ = 0.93; fall, κ = 0.92; high-risk motor vehicle collision, κ = 0.89; hanging, κ = 0.80). Fair agreement was found for clotheslining mechanisms (κ = 0.36) and substantial face injuries (κ = 0.40). Conclusions Most retrospectively assessed variables thought to be predictive of CSIs in blunt trauma-injured children had at least moderate interobserver agreement, suggesting that these data are sufficiently valid for use in identifying potential predictors of CSI.

UR - http://www.scopus.com/inward/record.url?scp=84926688307&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926688307&partnerID=8YFLogxK

U2 - 10.1111/acem.12630

DO - 10.1111/acem.12630

M3 - Article

C2 - 25779540

AN - SCOPUS:84926688307

VL - 22

SP - 487

EP - 491

JO - Academic Emergency Medicine

JF - Academic Emergency Medicine

SN - 1069-6563

IS - 4

ER -