Interrater reliability of the new criteria for behavioral variant frontotemporal dementia

Amanda K. La Marre, Katya Rascovsky, Alan Bostrom, Parnian Toofanian, Sarah Wilkins, Sharon J. Sha, David C. Perry, Zachary A. Miller, Georges Naasan, Robert Laforce, Jayne Hagen, Leonel T. Takada, Maria Carmela Tartaglia, Gail Kang, Douglas Galasko, David P. Salmon, Sarah E Tomaszewski Farias, Berneet Kaur, John M Olichney, Lovingly Quitania Park & 8 others Mario F. Mendez, Po Heng Tsai, Edmond Teng, Bradford Clark Dickerson, Kimiko Domoto-Reilly, Scott McGinnis, Bruce L. Miller, Joel H. Kramer

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Objective: To evaluate the interrater reliability of the new International Behavioural Variant FTD Criteria Consortium (FTDC) criteria for behavioral variant frontotemporal dementia (bvFTD). Methods: Twenty standardized clinical case modules were developed for patients with a range of neurodegenerative diagnoses, including bvFTD, primary progressive aphasia (nonfluent, semantic, and logopenic variant), Alzheimer disease, and Lewy body dementia. Eighteen blinded raters reviewed the modules and 1) rated the presence or absence of core diagnostic features for the FTDC criteria, and 2) provided an overall diagnostic rating. Interrater reliability was determined by k statistics for multiple raters with categorical ratings. Results: The mean k value for diagnostic agreement was 0.81 for possible bvFTD and 0.82 for probable bvFTD ("almost perfect agreement"). Interrater reliability for 4 of the 6 core features had "substantial" agreement (behavioral disinhibition, perseverative/compulsive, sympathy/empathy, hyperorality; k = 0.61-0.80), whereas 2 had "moderate" agreement (apathy/inertia, neuropsychological; k = 0.41-0.6). Clinician years of experience did not significantly influence rater accuracy. Conclusions: The FTDC criteria show promise for improving the diagnostic accuracy and reliability of clinicians and researchers. As disease-altering therapies are developed, accurate differential diagnosis between bvFTD and other neurodegenerative diseases will become increasingly important.

Original languageEnglish (US)
Pages (from-to)1973-1977
Number of pages5
JournalNeurology
Volume80
Issue number21
DOIs
StatePublished - May 21 2013

Fingerprint

Frontotemporal Dementia
Primary Progressive Nonfluent Aphasia
Lewy Body Disease
Apathy
Semantics
Neurodegenerative Diseases
Alzheimer Disease
Differential Diagnosis
Research Personnel
Interrater Reliability

ASJC Scopus subject areas

  • Clinical Neurology
  • Arts and Humanities (miscellaneous)

Cite this

La Marre, A. K., Rascovsky, K., Bostrom, A., Toofanian, P., Wilkins, S., Sha, S. J., ... Kramer, J. H. (2013). Interrater reliability of the new criteria for behavioral variant frontotemporal dementia. Neurology, 80(21), 1973-1977. https://doi.org/10.1212/WNL.0b013e318293e368

Interrater reliability of the new criteria for behavioral variant frontotemporal dementia. / La Marre, Amanda K.; Rascovsky, Katya; Bostrom, Alan; Toofanian, Parnian; Wilkins, Sarah; Sha, Sharon J.; Perry, David C.; Miller, Zachary A.; Naasan, Georges; Laforce, Robert; Hagen, Jayne; Takada, Leonel T.; Tartaglia, Maria Carmela; Kang, Gail; Galasko, Douglas; Salmon, David P.; Tomaszewski Farias, Sarah E; Kaur, Berneet; Olichney, John M; Park, Lovingly Quitania; Mendez, Mario F.; Tsai, Po Heng; Teng, Edmond; Dickerson, Bradford Clark; Domoto-Reilly, Kimiko; McGinnis, Scott; Miller, Bruce L.; Kramer, Joel H.

In: Neurology, Vol. 80, No. 21, 21.05.2013, p. 1973-1977.

Research output: Contribution to journalArticle

La Marre, AK, Rascovsky, K, Bostrom, A, Toofanian, P, Wilkins, S, Sha, SJ, Perry, DC, Miller, ZA, Naasan, G, Laforce, R, Hagen, J, Takada, LT, Tartaglia, MC, Kang, G, Galasko, D, Salmon, DP, Tomaszewski Farias, SE, Kaur, B, Olichney, JM, Park, LQ, Mendez, MF, Tsai, PH, Teng, E, Dickerson, BC, Domoto-Reilly, K, McGinnis, S, Miller, BL & Kramer, JH 2013, 'Interrater reliability of the new criteria for behavioral variant frontotemporal dementia', Neurology, vol. 80, no. 21, pp. 1973-1977. https://doi.org/10.1212/WNL.0b013e318293e368
La Marre AK, Rascovsky K, Bostrom A, Toofanian P, Wilkins S, Sha SJ et al. Interrater reliability of the new criteria for behavioral variant frontotemporal dementia. Neurology. 2013 May 21;80(21):1973-1977. https://doi.org/10.1212/WNL.0b013e318293e368
La Marre, Amanda K. ; Rascovsky, Katya ; Bostrom, Alan ; Toofanian, Parnian ; Wilkins, Sarah ; Sha, Sharon J. ; Perry, David C. ; Miller, Zachary A. ; Naasan, Georges ; Laforce, Robert ; Hagen, Jayne ; Takada, Leonel T. ; Tartaglia, Maria Carmela ; Kang, Gail ; Galasko, Douglas ; Salmon, David P. ; Tomaszewski Farias, Sarah E ; Kaur, Berneet ; Olichney, John M ; Park, Lovingly Quitania ; Mendez, Mario F. ; Tsai, Po Heng ; Teng, Edmond ; Dickerson, Bradford Clark ; Domoto-Reilly, Kimiko ; McGinnis, Scott ; Miller, Bruce L. ; Kramer, Joel H. / Interrater reliability of the new criteria for behavioral variant frontotemporal dementia. In: Neurology. 2013 ; Vol. 80, No. 21. pp. 1973-1977.
@article{f5ce89de7292402587c3691bb34e9e31,
title = "Interrater reliability of the new criteria for behavioral variant frontotemporal dementia",
abstract = "Objective: To evaluate the interrater reliability of the new International Behavioural Variant FTD Criteria Consortium (FTDC) criteria for behavioral variant frontotemporal dementia (bvFTD). Methods: Twenty standardized clinical case modules were developed for patients with a range of neurodegenerative diagnoses, including bvFTD, primary progressive aphasia (nonfluent, semantic, and logopenic variant), Alzheimer disease, and Lewy body dementia. Eighteen blinded raters reviewed the modules and 1) rated the presence or absence of core diagnostic features for the FTDC criteria, and 2) provided an overall diagnostic rating. Interrater reliability was determined by k statistics for multiple raters with categorical ratings. Results: The mean k value for diagnostic agreement was 0.81 for possible bvFTD and 0.82 for probable bvFTD ({"}almost perfect agreement{"}). Interrater reliability for 4 of the 6 core features had {"}substantial{"} agreement (behavioral disinhibition, perseverative/compulsive, sympathy/empathy, hyperorality; k = 0.61-0.80), whereas 2 had {"}moderate{"} agreement (apathy/inertia, neuropsychological; k = 0.41-0.6). Clinician years of experience did not significantly influence rater accuracy. Conclusions: The FTDC criteria show promise for improving the diagnostic accuracy and reliability of clinicians and researchers. As disease-altering therapies are developed, accurate differential diagnosis between bvFTD and other neurodegenerative diseases will become increasingly important.",
author = "{La Marre}, {Amanda K.} and Katya Rascovsky and Alan Bostrom and Parnian Toofanian and Sarah Wilkins and Sha, {Sharon J.} and Perry, {David C.} and Miller, {Zachary A.} and Georges Naasan and Robert Laforce and Jayne Hagen and Takada, {Leonel T.} and Tartaglia, {Maria Carmela} and Gail Kang and Douglas Galasko and Salmon, {David P.} and {Tomaszewski Farias}, {Sarah E} and Berneet Kaur and Olichney, {John M} and Park, {Lovingly Quitania} and Mendez, {Mario F.} and Tsai, {Po Heng} and Edmond Teng and Dickerson, {Bradford Clark} and Kimiko Domoto-Reilly and Scott McGinnis and Miller, {Bruce L.} and Kramer, {Joel H.}",
year = "2013",
month = "5",
day = "21",
doi = "10.1212/WNL.0b013e318293e368",
language = "English (US)",
volume = "80",
pages = "1973--1977",
journal = "Neurology",
issn = "0028-3878",
publisher = "Lippincott Williams and Wilkins",
number = "21",

}

TY - JOUR

T1 - Interrater reliability of the new criteria for behavioral variant frontotemporal dementia

AU - La Marre, Amanda K.

AU - Rascovsky, Katya

AU - Bostrom, Alan

AU - Toofanian, Parnian

AU - Wilkins, Sarah

AU - Sha, Sharon J.

AU - Perry, David C.

AU - Miller, Zachary A.

AU - Naasan, Georges

AU - Laforce, Robert

AU - Hagen, Jayne

AU - Takada, Leonel T.

AU - Tartaglia, Maria Carmela

AU - Kang, Gail

AU - Galasko, Douglas

AU - Salmon, David P.

AU - Tomaszewski Farias, Sarah E

AU - Kaur, Berneet

AU - Olichney, John M

AU - Park, Lovingly Quitania

AU - Mendez, Mario F.

AU - Tsai, Po Heng

AU - Teng, Edmond

AU - Dickerson, Bradford Clark

AU - Domoto-Reilly, Kimiko

AU - McGinnis, Scott

AU - Miller, Bruce L.

AU - Kramer, Joel H.

PY - 2013/5/21

Y1 - 2013/5/21

N2 - Objective: To evaluate the interrater reliability of the new International Behavioural Variant FTD Criteria Consortium (FTDC) criteria for behavioral variant frontotemporal dementia (bvFTD). Methods: Twenty standardized clinical case modules were developed for patients with a range of neurodegenerative diagnoses, including bvFTD, primary progressive aphasia (nonfluent, semantic, and logopenic variant), Alzheimer disease, and Lewy body dementia. Eighteen blinded raters reviewed the modules and 1) rated the presence or absence of core diagnostic features for the FTDC criteria, and 2) provided an overall diagnostic rating. Interrater reliability was determined by k statistics for multiple raters with categorical ratings. Results: The mean k value for diagnostic agreement was 0.81 for possible bvFTD and 0.82 for probable bvFTD ("almost perfect agreement"). Interrater reliability for 4 of the 6 core features had "substantial" agreement (behavioral disinhibition, perseverative/compulsive, sympathy/empathy, hyperorality; k = 0.61-0.80), whereas 2 had "moderate" agreement (apathy/inertia, neuropsychological; k = 0.41-0.6). Clinician years of experience did not significantly influence rater accuracy. Conclusions: The FTDC criteria show promise for improving the diagnostic accuracy and reliability of clinicians and researchers. As disease-altering therapies are developed, accurate differential diagnosis between bvFTD and other neurodegenerative diseases will become increasingly important.

AB - Objective: To evaluate the interrater reliability of the new International Behavioural Variant FTD Criteria Consortium (FTDC) criteria for behavioral variant frontotemporal dementia (bvFTD). Methods: Twenty standardized clinical case modules were developed for patients with a range of neurodegenerative diagnoses, including bvFTD, primary progressive aphasia (nonfluent, semantic, and logopenic variant), Alzheimer disease, and Lewy body dementia. Eighteen blinded raters reviewed the modules and 1) rated the presence or absence of core diagnostic features for the FTDC criteria, and 2) provided an overall diagnostic rating. Interrater reliability was determined by k statistics for multiple raters with categorical ratings. Results: The mean k value for diagnostic agreement was 0.81 for possible bvFTD and 0.82 for probable bvFTD ("almost perfect agreement"). Interrater reliability for 4 of the 6 core features had "substantial" agreement (behavioral disinhibition, perseverative/compulsive, sympathy/empathy, hyperorality; k = 0.61-0.80), whereas 2 had "moderate" agreement (apathy/inertia, neuropsychological; k = 0.41-0.6). Clinician years of experience did not significantly influence rater accuracy. Conclusions: The FTDC criteria show promise for improving the diagnostic accuracy and reliability of clinicians and researchers. As disease-altering therapies are developed, accurate differential diagnosis between bvFTD and other neurodegenerative diseases will become increasingly important.

UR - http://www.scopus.com/inward/record.url?scp=84879104941&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84879104941&partnerID=8YFLogxK

U2 - 10.1212/WNL.0b013e318293e368

DO - 10.1212/WNL.0b013e318293e368

M3 - Article

VL - 80

SP - 1973

EP - 1977

JO - Neurology

JF - Neurology

SN - 0028-3878

IS - 21

ER -