Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer

Kirti Malhotra, Joshua J. Fenton, Paul R. Duberstein, Ronald M. Epstein, Guibo Xing, Daniel J. Tancredi, Michael Hoerger, Robert Gramling, Richard L. Kravitz

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: In caring for patients with advanced cancer, accurate estimation of survival is important for clinical decision making. The purpose of this study was to assess the accuracy of 2-year survival probabilities estimated by oncologists, patients, and caregivers and to identify demographic and clinical factors associated with prognostic accuracy. Methods: This was a secondary observational analysis of data obtained from a cluster randomized controlled trial. Participants included 38 oncologists, 263 patients with advanced nonhematologic cancer, and 193 of their caregivers from clinics in Sacramento and Western New York. Discrimination within each group (oncologists, patients, caregivers) was evaluated using the C statistic, whereas calibration was assessed by comparing observed to predicted 2-year mortality using the chi-square statistic. Results: The median survival from study entry was 18 months, and 41.8% of patients survived for 2 years. C statistics for oncologists, patients, and caregivers were 0.81 (95% CI, 0.76-0.86), 0.62 (95% CI, 0.55-0.68), and 0.72 (95% CI, 0.65-0.78), respectively; oncologists’ predictions were better than the predictions of both patients (P =.001) and caregivers (P =.03). Oncologists also had superior calibration: their predictions of 2-year survival were similar to actual survival (P =.17), whereas patients’ (P =.0001) and caregivers’ (P =.003) predictions diverged significantly from actual survival. Although most oncologists’ predictions were classified as realistic (62.0%), approximately one-half of patients’ and caregivers’ predictions (50.0% and 46.0%, respectively) were unduly optimistic. Among patients, nonwhite race and higher levels of social well-being predicted undue optimism (P <.05). Conclusions: Compared with oncologists, patients and caregivers displayed inferior prognostic discrimination, and their predictions were poorly calibrated, primarily because of overoptimism.

Original languageEnglish (US)
JournalCancer
DOIs
StatePublished - Jan 1 2019

Fingerprint

Caregivers
Neoplasms
Survival
Calibration
Oncologists
Randomized Controlled Trials
Demography
Mortality

Keywords

  • advanced cancer
  • calibration
  • discrimination
  • optimistic
  • pessimistic
  • prognostic accuracy

ASJC Scopus subject areas

  • Oncology
  • Cancer Research

Cite this

Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer. / Malhotra, Kirti; Fenton, Joshua J.; Duberstein, Paul R.; Epstein, Ronald M.; Xing, Guibo; Tancredi, Daniel J.; Hoerger, Michael; Gramling, Robert; Kravitz, Richard L.

In: Cancer, 01.01.2019.

Research output: Contribution to journalArticle

Malhotra, Kirti ; Fenton, Joshua J. ; Duberstein, Paul R. ; Epstein, Ronald M. ; Xing, Guibo ; Tancredi, Daniel J. ; Hoerger, Michael ; Gramling, Robert ; Kravitz, Richard L. / Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer. In: Cancer. 2019.
@article{eab8f13423f345548fef49602b315e34,
title = "Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer",
abstract = "Background: In caring for patients with advanced cancer, accurate estimation of survival is important for clinical decision making. The purpose of this study was to assess the accuracy of 2-year survival probabilities estimated by oncologists, patients, and caregivers and to identify demographic and clinical factors associated with prognostic accuracy. Methods: This was a secondary observational analysis of data obtained from a cluster randomized controlled trial. Participants included 38 oncologists, 263 patients with advanced nonhematologic cancer, and 193 of their caregivers from clinics in Sacramento and Western New York. Discrimination within each group (oncologists, patients, caregivers) was evaluated using the C statistic, whereas calibration was assessed by comparing observed to predicted 2-year mortality using the chi-square statistic. Results: The median survival from study entry was 18 months, and 41.8{\%} of patients survived for 2 years. C statistics for oncologists, patients, and caregivers were 0.81 (95{\%} CI, 0.76-0.86), 0.62 (95{\%} CI, 0.55-0.68), and 0.72 (95{\%} CI, 0.65-0.78), respectively; oncologists’ predictions were better than the predictions of both patients (P =.001) and caregivers (P =.03). Oncologists also had superior calibration: their predictions of 2-year survival were similar to actual survival (P =.17), whereas patients’ (P =.0001) and caregivers’ (P =.003) predictions diverged significantly from actual survival. Although most oncologists’ predictions were classified as realistic (62.0{\%}), approximately one-half of patients’ and caregivers’ predictions (50.0{\%} and 46.0{\%}, respectively) were unduly optimistic. Among patients, nonwhite race and higher levels of social well-being predicted undue optimism (P <.05). Conclusions: Compared with oncologists, patients and caregivers displayed inferior prognostic discrimination, and their predictions were poorly calibrated, primarily because of overoptimism.",
keywords = "advanced cancer, calibration, discrimination, optimistic, pessimistic, prognostic accuracy",
author = "Kirti Malhotra and Fenton, {Joshua J.} and Duberstein, {Paul R.} and Epstein, {Ronald M.} and Guibo Xing and Tancredi, {Daniel J.} and Michael Hoerger and Robert Gramling and Kravitz, {Richard L.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1002/cncr.32127",
language = "English (US)",
journal = "Cancer",
issn = "0008-543X",
publisher = "John Wiley and Sons Inc.",

}

TY - JOUR

T1 - Prognostic accuracy of patients, caregivers, and oncologists in advanced cancer

AU - Malhotra, Kirti

AU - Fenton, Joshua J.

AU - Duberstein, Paul R.

AU - Epstein, Ronald M.

AU - Xing, Guibo

AU - Tancredi, Daniel J.

AU - Hoerger, Michael

AU - Gramling, Robert

AU - Kravitz, Richard L.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Background: In caring for patients with advanced cancer, accurate estimation of survival is important for clinical decision making. The purpose of this study was to assess the accuracy of 2-year survival probabilities estimated by oncologists, patients, and caregivers and to identify demographic and clinical factors associated with prognostic accuracy. Methods: This was a secondary observational analysis of data obtained from a cluster randomized controlled trial. Participants included 38 oncologists, 263 patients with advanced nonhematologic cancer, and 193 of their caregivers from clinics in Sacramento and Western New York. Discrimination within each group (oncologists, patients, caregivers) was evaluated using the C statistic, whereas calibration was assessed by comparing observed to predicted 2-year mortality using the chi-square statistic. Results: The median survival from study entry was 18 months, and 41.8% of patients survived for 2 years. C statistics for oncologists, patients, and caregivers were 0.81 (95% CI, 0.76-0.86), 0.62 (95% CI, 0.55-0.68), and 0.72 (95% CI, 0.65-0.78), respectively; oncologists’ predictions were better than the predictions of both patients (P =.001) and caregivers (P =.03). Oncologists also had superior calibration: their predictions of 2-year survival were similar to actual survival (P =.17), whereas patients’ (P =.0001) and caregivers’ (P =.003) predictions diverged significantly from actual survival. Although most oncologists’ predictions were classified as realistic (62.0%), approximately one-half of patients’ and caregivers’ predictions (50.0% and 46.0%, respectively) were unduly optimistic. Among patients, nonwhite race and higher levels of social well-being predicted undue optimism (P <.05). Conclusions: Compared with oncologists, patients and caregivers displayed inferior prognostic discrimination, and their predictions were poorly calibrated, primarily because of overoptimism.

AB - Background: In caring for patients with advanced cancer, accurate estimation of survival is important for clinical decision making. The purpose of this study was to assess the accuracy of 2-year survival probabilities estimated by oncologists, patients, and caregivers and to identify demographic and clinical factors associated with prognostic accuracy. Methods: This was a secondary observational analysis of data obtained from a cluster randomized controlled trial. Participants included 38 oncologists, 263 patients with advanced nonhematologic cancer, and 193 of their caregivers from clinics in Sacramento and Western New York. Discrimination within each group (oncologists, patients, caregivers) was evaluated using the C statistic, whereas calibration was assessed by comparing observed to predicted 2-year mortality using the chi-square statistic. Results: The median survival from study entry was 18 months, and 41.8% of patients survived for 2 years. C statistics for oncologists, patients, and caregivers were 0.81 (95% CI, 0.76-0.86), 0.62 (95% CI, 0.55-0.68), and 0.72 (95% CI, 0.65-0.78), respectively; oncologists’ predictions were better than the predictions of both patients (P =.001) and caregivers (P =.03). Oncologists also had superior calibration: their predictions of 2-year survival were similar to actual survival (P =.17), whereas patients’ (P =.0001) and caregivers’ (P =.003) predictions diverged significantly from actual survival. Although most oncologists’ predictions were classified as realistic (62.0%), approximately one-half of patients’ and caregivers’ predictions (50.0% and 46.0%, respectively) were unduly optimistic. Among patients, nonwhite race and higher levels of social well-being predicted undue optimism (P <.05). Conclusions: Compared with oncologists, patients and caregivers displayed inferior prognostic discrimination, and their predictions were poorly calibrated, primarily because of overoptimism.

KW - advanced cancer

KW - calibration

KW - discrimination

KW - optimistic

KW - pessimistic

KW - prognostic accuracy

UR - http://www.scopus.com/inward/record.url?scp=85065085149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065085149&partnerID=8YFLogxK

U2 - 10.1002/cncr.32127

DO - 10.1002/cncr.32127

M3 - Article

C2 - 31034597

AN - SCOPUS:85065085149

JO - Cancer

JF - Cancer

SN - 0008-543X

ER -