Test-retest reliability and validity of a frustration paradigm and irritability measures

Wan Ling Tseng, Elizabeth Moroney, Laura Machlin, Roxann Roberson-Nay, John M. Hettema, Dever Carney, Joel Stoddard, Kenneth A. Towbin, Daniel S. Pine, Ellen Leibenluft, Melissa A. Brotman

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Background Data on the reliability and validity of assessments for irritability, particularly behavioral paradigms, are limited. This study examined the test-retest reliability and validity of a frustration paradigm (the Affective Posner 2 task) and two irritability measures [the Affective Reactivity Index (ARI) and Child Behavior Checklist (CBCL) irritability]. Methods Participants were 109 youth from a general population sample of twins (aged 9–14 years). Participants completed two visits that were 2–4 weeks apart. At both visits, participants completed the Affective Posner 2 task and self-reported their irritability using the ARI. Parents reported their child's irritability using the ARI and completed the CBCL. Results The Affective Posner 2 task demonstrated good test-retest reliability, with intraclass correlations (ICCs) ranging from .44 to .78. The task effectively evoked negative affect (frustration and unhappiness) at both test and retest, demonstrating its construct validity. Moreover, self-rated frustration and unhappiness during the frustration components of the task correlated positively with self-reported but not parent-reported irritability, providing modest support for convergent validity. Parent- and child-reports of the ARI and parent-reports of the CBCL irritability measure showed excellent test-retest reliability, with ICCs ranging from .88 to .90. Limitations The sample consists of mostly twins aged 9–14 years from the communities. Thus, results may not generalize to non-twin samples or clinical samples outside of this age range. Conclusions The Affective Posner 2 paradigm and the ARI and CBCL irritability scales may be useful tools for longitudinal or treatment research on irritability.

Original languageEnglish (US)
Pages (from-to)38-45
Number of pages8
JournalJournal of Affective Disorders
Volume212
DOIs
StatePublished - Apr 1 2017

Fingerprint

Frustration
Reproducibility of Results
Child Behavior
Checklist
Parents
Research
Population

Keywords

  • Frustration
  • Irritability
  • Parent-child agreement
  • Test-retest reliability
  • Validity

ASJC Scopus subject areas

  • Clinical Psychology
  • Psychiatry and Mental health

Cite this

Tseng, W. L., Moroney, E., Machlin, L., Roberson-Nay, R., Hettema, J. M., Carney, D., ... Brotman, M. A. (2017). Test-retest reliability and validity of a frustration paradigm and irritability measures. Journal of Affective Disorders, 212, 38-45. https://doi.org/10.1016/j.jad.2017.01.024

Test-retest reliability and validity of a frustration paradigm and irritability measures. / Tseng, Wan Ling; Moroney, Elizabeth; Machlin, Laura; Roberson-Nay, Roxann; Hettema, John M.; Carney, Dever; Stoddard, Joel; Towbin, Kenneth A.; Pine, Daniel S.; Leibenluft, Ellen; Brotman, Melissa A.

In: Journal of Affective Disorders, Vol. 212, 01.04.2017, p. 38-45.

Research output: Contribution to journalArticle

Tseng, WL, Moroney, E, Machlin, L, Roberson-Nay, R, Hettema, JM, Carney, D, Stoddard, J, Towbin, KA, Pine, DS, Leibenluft, E & Brotman, MA 2017, 'Test-retest reliability and validity of a frustration paradigm and irritability measures', Journal of Affective Disorders, vol. 212, pp. 38-45. https://doi.org/10.1016/j.jad.2017.01.024
Tseng, Wan Ling ; Moroney, Elizabeth ; Machlin, Laura ; Roberson-Nay, Roxann ; Hettema, John M. ; Carney, Dever ; Stoddard, Joel ; Towbin, Kenneth A. ; Pine, Daniel S. ; Leibenluft, Ellen ; Brotman, Melissa A. / Test-retest reliability and validity of a frustration paradigm and irritability measures. In: Journal of Affective Disorders. 2017 ; Vol. 212. pp. 38-45.
@article{b23c29feb9364a62927ecc95f7766993,
title = "Test-retest reliability and validity of a frustration paradigm and irritability measures",
abstract = "Background Data on the reliability and validity of assessments for irritability, particularly behavioral paradigms, are limited. This study examined the test-retest reliability and validity of a frustration paradigm (the Affective Posner 2 task) and two irritability measures [the Affective Reactivity Index (ARI) and Child Behavior Checklist (CBCL) irritability]. Methods Participants were 109 youth from a general population sample of twins (aged 9–14 years). Participants completed two visits that were 2–4 weeks apart. At both visits, participants completed the Affective Posner 2 task and self-reported their irritability using the ARI. Parents reported their child's irritability using the ARI and completed the CBCL. Results The Affective Posner 2 task demonstrated good test-retest reliability, with intraclass correlations (ICCs) ranging from .44 to .78. The task effectively evoked negative affect (frustration and unhappiness) at both test and retest, demonstrating its construct validity. Moreover, self-rated frustration and unhappiness during the frustration components of the task correlated positively with self-reported but not parent-reported irritability, providing modest support for convergent validity. Parent- and child-reports of the ARI and parent-reports of the CBCL irritability measure showed excellent test-retest reliability, with ICCs ranging from .88 to .90. Limitations The sample consists of mostly twins aged 9–14 years from the communities. Thus, results may not generalize to non-twin samples or clinical samples outside of this age range. Conclusions The Affective Posner 2 paradigm and the ARI and CBCL irritability scales may be useful tools for longitudinal or treatment research on irritability.",
keywords = "Frustration, Irritability, Parent-child agreement, Test-retest reliability, Validity",
author = "Tseng, {Wan Ling} and Elizabeth Moroney and Laura Machlin and Roxann Roberson-Nay and Hettema, {John M.} and Dever Carney and Joel Stoddard and Towbin, {Kenneth A.} and Pine, {Daniel S.} and Ellen Leibenluft and Brotman, {Melissa A.}",
year = "2017",
month = "4",
day = "1",
doi = "10.1016/j.jad.2017.01.024",
language = "English (US)",
volume = "212",
pages = "38--45",
journal = "Journal of Affective Disorders",
issn = "0165-0327",
publisher = "Elsevier",

}

TY - JOUR

T1 - Test-retest reliability and validity of a frustration paradigm and irritability measures

AU - Tseng, Wan Ling

AU - Moroney, Elizabeth

AU - Machlin, Laura

AU - Roberson-Nay, Roxann

AU - Hettema, John M.

AU - Carney, Dever

AU - Stoddard, Joel

AU - Towbin, Kenneth A.

AU - Pine, Daniel S.

AU - Leibenluft, Ellen

AU - Brotman, Melissa A.

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Background Data on the reliability and validity of assessments for irritability, particularly behavioral paradigms, are limited. This study examined the test-retest reliability and validity of a frustration paradigm (the Affective Posner 2 task) and two irritability measures [the Affective Reactivity Index (ARI) and Child Behavior Checklist (CBCL) irritability]. Methods Participants were 109 youth from a general population sample of twins (aged 9–14 years). Participants completed two visits that were 2–4 weeks apart. At both visits, participants completed the Affective Posner 2 task and self-reported their irritability using the ARI. Parents reported their child's irritability using the ARI and completed the CBCL. Results The Affective Posner 2 task demonstrated good test-retest reliability, with intraclass correlations (ICCs) ranging from .44 to .78. The task effectively evoked negative affect (frustration and unhappiness) at both test and retest, demonstrating its construct validity. Moreover, self-rated frustration and unhappiness during the frustration components of the task correlated positively with self-reported but not parent-reported irritability, providing modest support for convergent validity. Parent- and child-reports of the ARI and parent-reports of the CBCL irritability measure showed excellent test-retest reliability, with ICCs ranging from .88 to .90. Limitations The sample consists of mostly twins aged 9–14 years from the communities. Thus, results may not generalize to non-twin samples or clinical samples outside of this age range. Conclusions The Affective Posner 2 paradigm and the ARI and CBCL irritability scales may be useful tools for longitudinal or treatment research on irritability.

AB - Background Data on the reliability and validity of assessments for irritability, particularly behavioral paradigms, are limited. This study examined the test-retest reliability and validity of a frustration paradigm (the Affective Posner 2 task) and two irritability measures [the Affective Reactivity Index (ARI) and Child Behavior Checklist (CBCL) irritability]. Methods Participants were 109 youth from a general population sample of twins (aged 9–14 years). Participants completed two visits that were 2–4 weeks apart. At both visits, participants completed the Affective Posner 2 task and self-reported their irritability using the ARI. Parents reported their child's irritability using the ARI and completed the CBCL. Results The Affective Posner 2 task demonstrated good test-retest reliability, with intraclass correlations (ICCs) ranging from .44 to .78. The task effectively evoked negative affect (frustration and unhappiness) at both test and retest, demonstrating its construct validity. Moreover, self-rated frustration and unhappiness during the frustration components of the task correlated positively with self-reported but not parent-reported irritability, providing modest support for convergent validity. Parent- and child-reports of the ARI and parent-reports of the CBCL irritability measure showed excellent test-retest reliability, with ICCs ranging from .88 to .90. Limitations The sample consists of mostly twins aged 9–14 years from the communities. Thus, results may not generalize to non-twin samples or clinical samples outside of this age range. Conclusions The Affective Posner 2 paradigm and the ARI and CBCL irritability scales may be useful tools for longitudinal or treatment research on irritability.

KW - Frustration

KW - Irritability

KW - Parent-child agreement

KW - Test-retest reliability

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=85010705294&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85010705294&partnerID=8YFLogxK

U2 - 10.1016/j.jad.2017.01.024

DO - 10.1016/j.jad.2017.01.024

M3 - Article

AN - SCOPUS:85010705294

VL - 212

SP - 38

EP - 45

JO - Journal of Affective Disorders

JF - Journal of Affective Disorders

SN - 0165-0327

ER -