The effects of repeat testing, malingering, and traumatic brain injury on computerized measures of visuospatial memory Span

David L Woods, John M. Wyma, Timothy J. Herron, E. W. Yund

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Spatial span tests (SSTs) such as the Corsi Block Test (CBT) and the SST of the Wechsler Memory Scale are widely used to assess deficits in spatial working memory. We conducted three experiments to evaluate the test-retest reliability and clinical sensitivity of a new computerized spatial span test (C-SST) that incorporates psychophysical methods to improve the precision of spatial span measurement. In Experiment 1, we analyzed C-SST test-retest reliability in 49 participants who underwent three test sessions at weekly intervals. Intraclass correlation coefficients (ICC) were higher for a psychophysically derived mean span (MnS) metric (0.83) than for the maximal span and total correct metrics used in traditional spatial-span tests. Response times (ReTs) also showed high ICCs (0.93) that correlated negatively with MnS scores and correlated positively with response-time latencies from other tests of processing speed. Learning effects were insignificant. Experiment 2 examined the performance of Experiment 1 participants when instructed to feign symptoms of traumatic brain injury (TBI): 57% showed abnormal MnS z-scores. A MnS z-score cutoff of 3.0 correctly classified 36% of simulated malingerers and 91% of the subgroup of 11 control participants with abnormal spans. Malingerers also made more substitution errors than control participants with abnormal spans (sensitivity = 43%, specificity = 91%). In addition, malingerers showed no evidence of ReT slowing, in contrast to significant abnormalities seen on other malingered tests of processing speed. As a result, differences between ReT z-scores and z-scores on other processing speed tests showed very high sensitivity and specificity in distinguishing malingering and control participants with either normal or abnormal spans. Experiment 3 examined C-SST performance in a group of patients with predominantly mild TBI: neither MnS nor ReT z-scores showed significant group-level abnormalities. The C-SST improves the reliability and sensitivity of spatial span testing, can accurately detect malingering, and shows that visuospatial working memory is largely preserved in patients with predominantly mild TBI.

Original languageEnglish (US)
Article number690
JournalFrontiers in Human Neuroscience
Volume9
Issue numberJAN2016
DOIs
StatePublished - Jan 5 2016

Fingerprint

Malingering
Brain Concussion
Reaction Time
Short-Term Memory
Reproducibility of Results
Wechsler Scales
Sensitivity and Specificity
Learning
Traumatic Brain Injury

Keywords

  • Computer
  • Concussion
  • Digit span
  • Feigning
  • Head injury
  • Reaction time
  • Reliability

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Neurology
  • Biological Psychiatry
  • Behavioral Neuroscience
  • Neuropsychology and Physiological Psychology

Cite this

The effects of repeat testing, malingering, and traumatic brain injury on computerized measures of visuospatial memory Span. / Woods, David L; Wyma, John M.; Herron, Timothy J.; Yund, E. W.

In: Frontiers in Human Neuroscience, Vol. 9, No. JAN2016, 690, 05.01.2016.

Research output: Contribution to journalArticle

@article{07f31c662b984dd49d04ec46e69b377e,
title = "The effects of repeat testing, malingering, and traumatic brain injury on computerized measures of visuospatial memory Span",
abstract = "Spatial span tests (SSTs) such as the Corsi Block Test (CBT) and the SST of the Wechsler Memory Scale are widely used to assess deficits in spatial working memory. We conducted three experiments to evaluate the test-retest reliability and clinical sensitivity of a new computerized spatial span test (C-SST) that incorporates psychophysical methods to improve the precision of spatial span measurement. In Experiment 1, we analyzed C-SST test-retest reliability in 49 participants who underwent three test sessions at weekly intervals. Intraclass correlation coefficients (ICC) were higher for a psychophysically derived mean span (MnS) metric (0.83) than for the maximal span and total correct metrics used in traditional spatial-span tests. Response times (ReTs) also showed high ICCs (0.93) that correlated negatively with MnS scores and correlated positively with response-time latencies from other tests of processing speed. Learning effects were insignificant. Experiment 2 examined the performance of Experiment 1 participants when instructed to feign symptoms of traumatic brain injury (TBI): 57{\%} showed abnormal MnS z-scores. A MnS z-score cutoff of 3.0 correctly classified 36{\%} of simulated malingerers and 91{\%} of the subgroup of 11 control participants with abnormal spans. Malingerers also made more substitution errors than control participants with abnormal spans (sensitivity = 43{\%}, specificity = 91{\%}). In addition, malingerers showed no evidence of ReT slowing, in contrast to significant abnormalities seen on other malingered tests of processing speed. As a result, differences between ReT z-scores and z-scores on other processing speed tests showed very high sensitivity and specificity in distinguishing malingering and control participants with either normal or abnormal spans. Experiment 3 examined C-SST performance in a group of patients with predominantly mild TBI: neither MnS nor ReT z-scores showed significant group-level abnormalities. The C-SST improves the reliability and sensitivity of spatial span testing, can accurately detect malingering, and shows that visuospatial working memory is largely preserved in patients with predominantly mild TBI.",
keywords = "Computer, Concussion, Digit span, Feigning, Head injury, Reaction time, Reliability",
author = "Woods, {David L} and Wyma, {John M.} and Herron, {Timothy J.} and Yund, {E. W.}",
year = "2016",
month = "1",
day = "5",
doi = "10.3389/fnhum.2015.00690",
language = "English (US)",
volume = "9",
journal = "Hematology / the Education Program of the American Society of Hematology. American Society of Hematology. Education Program",
issn = "1662-5161",
publisher = "Frontiers Research Foundation",
number = "JAN2016",

}

TY - JOUR

T1 - The effects of repeat testing, malingering, and traumatic brain injury on computerized measures of visuospatial memory Span

AU - Woods, David L

AU - Wyma, John M.

AU - Herron, Timothy J.

AU - Yund, E. W.

PY - 2016/1/5

Y1 - 2016/1/5

N2 - Spatial span tests (SSTs) such as the Corsi Block Test (CBT) and the SST of the Wechsler Memory Scale are widely used to assess deficits in spatial working memory. We conducted three experiments to evaluate the test-retest reliability and clinical sensitivity of a new computerized spatial span test (C-SST) that incorporates psychophysical methods to improve the precision of spatial span measurement. In Experiment 1, we analyzed C-SST test-retest reliability in 49 participants who underwent three test sessions at weekly intervals. Intraclass correlation coefficients (ICC) were higher for a psychophysically derived mean span (MnS) metric (0.83) than for the maximal span and total correct metrics used in traditional spatial-span tests. Response times (ReTs) also showed high ICCs (0.93) that correlated negatively with MnS scores and correlated positively with response-time latencies from other tests of processing speed. Learning effects were insignificant. Experiment 2 examined the performance of Experiment 1 participants when instructed to feign symptoms of traumatic brain injury (TBI): 57% showed abnormal MnS z-scores. A MnS z-score cutoff of 3.0 correctly classified 36% of simulated malingerers and 91% of the subgroup of 11 control participants with abnormal spans. Malingerers also made more substitution errors than control participants with abnormal spans (sensitivity = 43%, specificity = 91%). In addition, malingerers showed no evidence of ReT slowing, in contrast to significant abnormalities seen on other malingered tests of processing speed. As a result, differences between ReT z-scores and z-scores on other processing speed tests showed very high sensitivity and specificity in distinguishing malingering and control participants with either normal or abnormal spans. Experiment 3 examined C-SST performance in a group of patients with predominantly mild TBI: neither MnS nor ReT z-scores showed significant group-level abnormalities. The C-SST improves the reliability and sensitivity of spatial span testing, can accurately detect malingering, and shows that visuospatial working memory is largely preserved in patients with predominantly mild TBI.

AB - Spatial span tests (SSTs) such as the Corsi Block Test (CBT) and the SST of the Wechsler Memory Scale are widely used to assess deficits in spatial working memory. We conducted three experiments to evaluate the test-retest reliability and clinical sensitivity of a new computerized spatial span test (C-SST) that incorporates psychophysical methods to improve the precision of spatial span measurement. In Experiment 1, we analyzed C-SST test-retest reliability in 49 participants who underwent three test sessions at weekly intervals. Intraclass correlation coefficients (ICC) were higher for a psychophysically derived mean span (MnS) metric (0.83) than for the maximal span and total correct metrics used in traditional spatial-span tests. Response times (ReTs) also showed high ICCs (0.93) that correlated negatively with MnS scores and correlated positively with response-time latencies from other tests of processing speed. Learning effects were insignificant. Experiment 2 examined the performance of Experiment 1 participants when instructed to feign symptoms of traumatic brain injury (TBI): 57% showed abnormal MnS z-scores. A MnS z-score cutoff of 3.0 correctly classified 36% of simulated malingerers and 91% of the subgroup of 11 control participants with abnormal spans. Malingerers also made more substitution errors than control participants with abnormal spans (sensitivity = 43%, specificity = 91%). In addition, malingerers showed no evidence of ReT slowing, in contrast to significant abnormalities seen on other malingered tests of processing speed. As a result, differences between ReT z-scores and z-scores on other processing speed tests showed very high sensitivity and specificity in distinguishing malingering and control participants with either normal or abnormal spans. Experiment 3 examined C-SST performance in a group of patients with predominantly mild TBI: neither MnS nor ReT z-scores showed significant group-level abnormalities. The C-SST improves the reliability and sensitivity of spatial span testing, can accurately detect malingering, and shows that visuospatial working memory is largely preserved in patients with predominantly mild TBI.

KW - Computer

KW - Concussion

KW - Digit span

KW - Feigning

KW - Head injury

KW - Reaction time

KW - Reliability

UR - http://www.scopus.com/inward/record.url?scp=84956610284&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84956610284&partnerID=8YFLogxK

U2 - 10.3389/fnhum.2015.00690

DO - 10.3389/fnhum.2015.00690

M3 - Article

AN - SCOPUS:84956610284

VL - 9

JO - Hematology / the Education Program of the American Society of Hematology. American Society of Hematology. Education Program

JF - Hematology / the Education Program of the American Society of Hematology. American Society of Hematology. Education Program

SN - 1662-5161

IS - JAN2016

M1 - 690

ER -