Reliability and validity of composite scores from the NIH toolbox cognition battery in adults

Robert K. Heaton, Natacha Akshoomoff, David Tulsky, Dan M Mungas, Sandra Weintraub, Sureyya Dikmen, Jennifer Beaumont, Kaitlin B. Casaletto, Kevin Conway, Jerry Slotkin, Richard Gershon

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: Crystallized Cognition Composite, Fluid Cognition Composite, and Total Cognition Composite scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

Original languageEnglish (US)
Pages (from-to)588-598
Number of pages11
JournalJournal of the International Neuropsychological Society
Volume20
Issue number6
DOIs
StatePublished - 2014

Fingerprint

Reproducibility of Results
Cognition
cognition
gold standard
Epidemiologic Studies
Battery
Aptitude
Episodic Memory
Executive Function
cognitive ability
Short-Term Memory
Psychometrics
psychometrics
Health Status
health status
Language
ethnicity
disability
Demography
Clinical Trials

Keywords

  • Attention
  • Cognitive assessment
  • Cognitive screener
  • Executive Function
  • Memory
  • Neuropsychological assessment

ASJC Scopus subject areas

  • Clinical Neurology
  • Psychiatry and Mental health
  • Clinical Psychology
  • Neuroscience(all)
  • Language and Linguistics
  • Linguistics and Language

Cite this

Reliability and validity of composite scores from the NIH toolbox cognition battery in adults. / Heaton, Robert K.; Akshoomoff, Natacha; Tulsky, David; Mungas, Dan M; Weintraub, Sandra; Dikmen, Sureyya; Beaumont, Jennifer; Casaletto, Kaitlin B.; Conway, Kevin; Slotkin, Jerry; Gershon, Richard.

In: Journal of the International Neuropsychological Society, Vol. 20, No. 6, 2014, p. 588-598.

Research output: Contribution to journalArticle

Heaton, RK, Akshoomoff, N, Tulsky, D, Mungas, DM, Weintraub, S, Dikmen, S, Beaumont, J, Casaletto, KB, Conway, K, Slotkin, J & Gershon, R 2014, 'Reliability and validity of composite scores from the NIH toolbox cognition battery in adults', Journal of the International Neuropsychological Society, vol. 20, no. 6, pp. 588-598. https://doi.org/10.1017/S1355617714000241
Heaton, Robert K. ; Akshoomoff, Natacha ; Tulsky, David ; Mungas, Dan M ; Weintraub, Sandra ; Dikmen, Sureyya ; Beaumont, Jennifer ; Casaletto, Kaitlin B. ; Conway, Kevin ; Slotkin, Jerry ; Gershon, Richard. / Reliability and validity of composite scores from the NIH toolbox cognition battery in adults. In: Journal of the International Neuropsychological Society. 2014 ; Vol. 20, No. 6. pp. 588-598.
@article{44033a05a70b4722819871ff98d9780a,
title = "Reliability and validity of composite scores from the NIH toolbox cognition battery in adults",
abstract = "This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: Crystallized Cognition Composite, Fluid Cognition Composite, and Total Cognition Composite scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.",
keywords = "Attention, Cognitive assessment, Cognitive screener, Executive Function, Memory, Neuropsychological assessment",
author = "Heaton, {Robert K.} and Natacha Akshoomoff and David Tulsky and Mungas, {Dan M} and Sandra Weintraub and Sureyya Dikmen and Jennifer Beaumont and Casaletto, {Kaitlin B.} and Kevin Conway and Jerry Slotkin and Richard Gershon",
year = "2014",
doi = "10.1017/S1355617714000241",
language = "English (US)",
volume = "20",
pages = "588--598",
journal = "Journal of the International Neuropsychological Society",
issn = "1355-6177",
publisher = "Cambridge University Press",
number = "6",

}

TY - JOUR

T1 - Reliability and validity of composite scores from the NIH toolbox cognition battery in adults

AU - Heaton, Robert K.

AU - Akshoomoff, Natacha

AU - Tulsky, David

AU - Mungas, Dan M

AU - Weintraub, Sandra

AU - Dikmen, Sureyya

AU - Beaumont, Jennifer

AU - Casaletto, Kaitlin B.

AU - Conway, Kevin

AU - Slotkin, Jerry

AU - Gershon, Richard

PY - 2014

Y1 - 2014

N2 - This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: Crystallized Cognition Composite, Fluid Cognition Composite, and Total Cognition Composite scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

AB - This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: Crystallized Cognition Composite, Fluid Cognition Composite, and Total Cognition Composite scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

KW - Attention

KW - Cognitive assessment

KW - Cognitive screener

KW - Executive Function

KW - Memory

KW - Neuropsychological assessment

UR - http://www.scopus.com/inward/record.url?scp=84904741909&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84904741909&partnerID=8YFLogxK

U2 - 10.1017/S1355617714000241

DO - 10.1017/S1355617714000241

M3 - Article

C2 - 24960398

AN - SCOPUS:84904741909

VL - 20

SP - 588

EP - 598

JO - Journal of the International Neuropsychological Society

JF - Journal of the International Neuropsychological Society

SN - 1355-6177

IS - 6

ER -