Personalized prediction of psychosis: External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project

Ricardo E. Carrión, Barbara A. Cornblatt, Cynthia Z. Burton, Ivy F. Tso, Andrea M. Auther, Steven Adelsheim, Roderick Calkins, Cameron S Carter, Tara A Niendam, Tamara G. Sale, Stephan F. Taylor, William R. McFarlane

Research output: Contribution to journalReview article

66 Citations (Scopus)

Abstract

Objective: As part of the second phase of the North American Prodrome Longitudinal Study (NAPLS-2), Cannon and colleagues report, concurrently with the present article, on a risk calculator for the individualized prediction of a psychotic disorder in a 2-year period. The present study represents an external validation of the NAPLS-2 psychosis risk calculator using an independent sample of patients at clinical high risk for psychosis collected as part of the Early Detection, Intervention, and Prevention of Psychosis Program (EDIPPP). Method: Of the total EDIPPP sample of 210 subjects rated as being at clinical high risk basedonthe Structured Interview for Prodromal Syndromes, 176 had at least one follow-up assessment and were included in the construction of a new prediction model with six predictor variables in the NAPLS-2 psychosis risk calculator (unusual thoughts and suspiciousness, symbol coding test performance, verbal learning test performance, decline in social functioning, baseline age, and family history). Discrimination performance was assessed with the area under the receiver operating characteristic curve (AUC). The NAPLS-2 risk calculator was then used to generate a psychosis risk estimate for each case in the external validation sample. Results: The external validation model showed good discrimination, with an AUC of 0.790 (95% CI=0.644-0.937). In addition, the personalized risk generated by the risk calculator provided a solid estimation of the actual conversion outcome in the validation sample. Conclusions: Two independent samples of clinical high-risk patients converge to validate the NAPLS-2 psychosis risk calculator. This prediction calculator represents a meaningful step toward early intervention and the personalized treatment of psychotic disorders.

Original languageEnglish (US)
Pages (from-to)989-996
Number of pages8
JournalAmerican Journal of Psychiatry
Volume173
Issue number10
DOIs
StatePublished - Oct 1 2016
Externally publishedYes

Fingerprint

Psychotic Disorders
Area Under Curve
Prodromal Symptoms
Verbal Learning
ROC Curve
Longitudinal Studies
Interviews

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

Carrión, R. E., Cornblatt, B. A., Burton, C. Z., Tso, I. F., Auther, A. M., Adelsheim, S., ... McFarlane, W. R. (2016). Personalized prediction of psychosis: External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project. American Journal of Psychiatry, 173(10), 989-996. https://doi.org/10.1176/appi.ajp.2016.15121565

Personalized prediction of psychosis : External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project. / Carrión, Ricardo E.; Cornblatt, Barbara A.; Burton, Cynthia Z.; Tso, Ivy F.; Auther, Andrea M.; Adelsheim, Steven; Calkins, Roderick; Carter, Cameron S; Niendam, Tara A; Sale, Tamara G.; Taylor, Stephan F.; McFarlane, William R.

In: American Journal of Psychiatry, Vol. 173, No. 10, 01.10.2016, p. 989-996.

Research output: Contribution to journalReview article

Carrión, RE, Cornblatt, BA, Burton, CZ, Tso, IF, Auther, AM, Adelsheim, S, Calkins, R, Carter, CS, Niendam, TA, Sale, TG, Taylor, SF & McFarlane, WR 2016, 'Personalized prediction of psychosis: External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project', American Journal of Psychiatry, vol. 173, no. 10, pp. 989-996. https://doi.org/10.1176/appi.ajp.2016.15121565
Carrión, Ricardo E. ; Cornblatt, Barbara A. ; Burton, Cynthia Z. ; Tso, Ivy F. ; Auther, Andrea M. ; Adelsheim, Steven ; Calkins, Roderick ; Carter, Cameron S ; Niendam, Tara A ; Sale, Tamara G. ; Taylor, Stephan F. ; McFarlane, William R. / Personalized prediction of psychosis : External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project. In: American Journal of Psychiatry. 2016 ; Vol. 173, No. 10. pp. 989-996.
@article{2ceeadd1eb0642d8b213b5781fbc7097,
title = "Personalized prediction of psychosis: External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project",
abstract = "Objective: As part of the second phase of the North American Prodrome Longitudinal Study (NAPLS-2), Cannon and colleagues report, concurrently with the present article, on a risk calculator for the individualized prediction of a psychotic disorder in a 2-year period. The present study represents an external validation of the NAPLS-2 psychosis risk calculator using an independent sample of patients at clinical high risk for psychosis collected as part of the Early Detection, Intervention, and Prevention of Psychosis Program (EDIPPP). Method: Of the total EDIPPP sample of 210 subjects rated as being at clinical high risk basedonthe Structured Interview for Prodromal Syndromes, 176 had at least one follow-up assessment and were included in the construction of a new prediction model with six predictor variables in the NAPLS-2 psychosis risk calculator (unusual thoughts and suspiciousness, symbol coding test performance, verbal learning test performance, decline in social functioning, baseline age, and family history). Discrimination performance was assessed with the area under the receiver operating characteristic curve (AUC). The NAPLS-2 risk calculator was then used to generate a psychosis risk estimate for each case in the external validation sample. Results: The external validation model showed good discrimination, with an AUC of 0.790 (95{\%} CI=0.644-0.937). In addition, the personalized risk generated by the risk calculator provided a solid estimation of the actual conversion outcome in the validation sample. Conclusions: Two independent samples of clinical high-risk patients converge to validate the NAPLS-2 psychosis risk calculator. This prediction calculator represents a meaningful step toward early intervention and the personalized treatment of psychotic disorders.",
author = "Carri{\'o}n, {Ricardo E.} and Cornblatt, {Barbara A.} and Burton, {Cynthia Z.} and Tso, {Ivy F.} and Auther, {Andrea M.} and Steven Adelsheim and Roderick Calkins and Carter, {Cameron S} and Niendam, {Tara A} and Sale, {Tamara G.} and Taylor, {Stephan F.} and McFarlane, {William R.}",
year = "2016",
month = "10",
day = "1",
doi = "10.1176/appi.ajp.2016.15121565",
language = "English (US)",
volume = "173",
pages = "989--996",
journal = "American Journal of Psychiatry",
issn = "0002-953X",
publisher = "American Psychiatric Association",
number = "10",

}

TY - JOUR

T1 - Personalized prediction of psychosis

T2 - External validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project

AU - Carrión, Ricardo E.

AU - Cornblatt, Barbara A.

AU - Burton, Cynthia Z.

AU - Tso, Ivy F.

AU - Auther, Andrea M.

AU - Adelsheim, Steven

AU - Calkins, Roderick

AU - Carter, Cameron S

AU - Niendam, Tara A

AU - Sale, Tamara G.

AU - Taylor, Stephan F.

AU - McFarlane, William R.

PY - 2016/10/1

Y1 - 2016/10/1

N2 - Objective: As part of the second phase of the North American Prodrome Longitudinal Study (NAPLS-2), Cannon and colleagues report, concurrently with the present article, on a risk calculator for the individualized prediction of a psychotic disorder in a 2-year period. The present study represents an external validation of the NAPLS-2 psychosis risk calculator using an independent sample of patients at clinical high risk for psychosis collected as part of the Early Detection, Intervention, and Prevention of Psychosis Program (EDIPPP). Method: Of the total EDIPPP sample of 210 subjects rated as being at clinical high risk basedonthe Structured Interview for Prodromal Syndromes, 176 had at least one follow-up assessment and were included in the construction of a new prediction model with six predictor variables in the NAPLS-2 psychosis risk calculator (unusual thoughts and suspiciousness, symbol coding test performance, verbal learning test performance, decline in social functioning, baseline age, and family history). Discrimination performance was assessed with the area under the receiver operating characteristic curve (AUC). The NAPLS-2 risk calculator was then used to generate a psychosis risk estimate for each case in the external validation sample. Results: The external validation model showed good discrimination, with an AUC of 0.790 (95% CI=0.644-0.937). In addition, the personalized risk generated by the risk calculator provided a solid estimation of the actual conversion outcome in the validation sample. Conclusions: Two independent samples of clinical high-risk patients converge to validate the NAPLS-2 psychosis risk calculator. This prediction calculator represents a meaningful step toward early intervention and the personalized treatment of psychotic disorders.

AB - Objective: As part of the second phase of the North American Prodrome Longitudinal Study (NAPLS-2), Cannon and colleagues report, concurrently with the present article, on a risk calculator for the individualized prediction of a psychotic disorder in a 2-year period. The present study represents an external validation of the NAPLS-2 psychosis risk calculator using an independent sample of patients at clinical high risk for psychosis collected as part of the Early Detection, Intervention, and Prevention of Psychosis Program (EDIPPP). Method: Of the total EDIPPP sample of 210 subjects rated as being at clinical high risk basedonthe Structured Interview for Prodromal Syndromes, 176 had at least one follow-up assessment and were included in the construction of a new prediction model with six predictor variables in the NAPLS-2 psychosis risk calculator (unusual thoughts and suspiciousness, symbol coding test performance, verbal learning test performance, decline in social functioning, baseline age, and family history). Discrimination performance was assessed with the area under the receiver operating characteristic curve (AUC). The NAPLS-2 risk calculator was then used to generate a psychosis risk estimate for each case in the external validation sample. Results: The external validation model showed good discrimination, with an AUC of 0.790 (95% CI=0.644-0.937). In addition, the personalized risk generated by the risk calculator provided a solid estimation of the actual conversion outcome in the validation sample. Conclusions: Two independent samples of clinical high-risk patients converge to validate the NAPLS-2 psychosis risk calculator. This prediction calculator represents a meaningful step toward early intervention and the personalized treatment of psychotic disorders.

UR - http://www.scopus.com/inward/record.url?scp=84988842527&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988842527&partnerID=8YFLogxK

U2 - 10.1176/appi.ajp.2016.15121565

DO - 10.1176/appi.ajp.2016.15121565

M3 - Review article

C2 - 27363511

AN - SCOPUS:84988842527

VL - 173

SP - 989

EP - 996

JO - American Journal of Psychiatry

JF - American Journal of Psychiatry

SN - 0002-953X

IS - 10

ER -