An equivalent relative utility metric for evaluating screening mammography

Craig K. Abbey, Miguel P. Eckstein, John M Boone

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Comparative studies of performance in screening mammography are often ambiguous. A new method will frequently show a higher sensitivity or detection rate than an existing standard with a concomitant increase in false positives or recalls. The authors propose an equivalent relative utility (ERU) metric based on signal detection theory to quantify screening performance in such comparisons. The metric is defined as the relative utility, as defined in classical signal detection theory, needed to make 2 systems equivalent. ERU avoids the problem of requiring a predefined putative relative utility, which has limited application of utility theory in receiver operating characteristic analysis. The metric can be readily estimated from recall and detection rates commonly reported in comparative clinical studies. An important practical advantage of ERU is that in prevalence matched populations, the measure can be estimated without an independent estimate of disease prevalence. Thus estimating ERU does not require a study with long-term follow-up to find cases of missed disease. The approach is applicable to any comparative screening study that reports results in terms of recall and detection rates, although the authors focus exclusively on screening mammography in this work. They derive the ERU from the definition of utility given in classical treatments of signal detection theory. They also investigate reasonable values of relative utility in screening mammography for use in interpreting ERU using data from a large clinical study. As examples of application of ERU, they reanalyze 2 recently published reports using recall and detection rates in screening mammography.

Original languageEnglish (US)
Pages (from-to)113-122
Number of pages10
JournalMedical Decision Making
Volume30
Issue number1
DOIs
StatePublished - Jan 2010

Fingerprint

Mammography
ROC Curve
Economics
Population
Psychological Signal Detection
Clinical Studies

Keywords

  • Decision Theory
  • Relative utility
  • ROC analysis
  • Screening mammography

ASJC Scopus subject areas

  • Health Policy
  • Medicine(all)

Cite this

An equivalent relative utility metric for evaluating screening mammography. / Abbey, Craig K.; Eckstein, Miguel P.; Boone, John M.

In: Medical Decision Making, Vol. 30, No. 1, 01.2010, p. 113-122.

Research output: Contribution to journalArticle

Abbey, Craig K. ; Eckstein, Miguel P. ; Boone, John M. / An equivalent relative utility metric for evaluating screening mammography. In: Medical Decision Making. 2010 ; Vol. 30, No. 1. pp. 113-122.
@article{d89207e168fa436f883713183e688489,
title = "An equivalent relative utility metric for evaluating screening mammography",
abstract = "Comparative studies of performance in screening mammography are often ambiguous. A new method will frequently show a higher sensitivity or detection rate than an existing standard with a concomitant increase in false positives or recalls. The authors propose an equivalent relative utility (ERU) metric based on signal detection theory to quantify screening performance in such comparisons. The metric is defined as the relative utility, as defined in classical signal detection theory, needed to make 2 systems equivalent. ERU avoids the problem of requiring a predefined putative relative utility, which has limited application of utility theory in receiver operating characteristic analysis. The metric can be readily estimated from recall and detection rates commonly reported in comparative clinical studies. An important practical advantage of ERU is that in prevalence matched populations, the measure can be estimated without an independent estimate of disease prevalence. Thus estimating ERU does not require a study with long-term follow-up to find cases of missed disease. The approach is applicable to any comparative screening study that reports results in terms of recall and detection rates, although the authors focus exclusively on screening mammography in this work. They derive the ERU from the definition of utility given in classical treatments of signal detection theory. They also investigate reasonable values of relative utility in screening mammography for use in interpreting ERU using data from a large clinical study. As examples of application of ERU, they reanalyze 2 recently published reports using recall and detection rates in screening mammography.",
keywords = "Decision Theory, Relative utility, ROC analysis, Screening mammography",
author = "Abbey, {Craig K.} and Eckstein, {Miguel P.} and Boone, {John M}",
year = "2010",
month = "1",
doi = "10.1177/0272989X09341753",
language = "English (US)",
volume = "30",
pages = "113--122",
journal = "Medical Decision Making",
issn = "0272-989X",
publisher = "SAGE Publications Inc.",
number = "1",

}

TY - JOUR

T1 - An equivalent relative utility metric for evaluating screening mammography

AU - Abbey, Craig K.

AU - Eckstein, Miguel P.

AU - Boone, John M

PY - 2010/1

Y1 - 2010/1

N2 - Comparative studies of performance in screening mammography are often ambiguous. A new method will frequently show a higher sensitivity or detection rate than an existing standard with a concomitant increase in false positives or recalls. The authors propose an equivalent relative utility (ERU) metric based on signal detection theory to quantify screening performance in such comparisons. The metric is defined as the relative utility, as defined in classical signal detection theory, needed to make 2 systems equivalent. ERU avoids the problem of requiring a predefined putative relative utility, which has limited application of utility theory in receiver operating characteristic analysis. The metric can be readily estimated from recall and detection rates commonly reported in comparative clinical studies. An important practical advantage of ERU is that in prevalence matched populations, the measure can be estimated without an independent estimate of disease prevalence. Thus estimating ERU does not require a study with long-term follow-up to find cases of missed disease. The approach is applicable to any comparative screening study that reports results in terms of recall and detection rates, although the authors focus exclusively on screening mammography in this work. They derive the ERU from the definition of utility given in classical treatments of signal detection theory. They also investigate reasonable values of relative utility in screening mammography for use in interpreting ERU using data from a large clinical study. As examples of application of ERU, they reanalyze 2 recently published reports using recall and detection rates in screening mammography.

AB - Comparative studies of performance in screening mammography are often ambiguous. A new method will frequently show a higher sensitivity or detection rate than an existing standard with a concomitant increase in false positives or recalls. The authors propose an equivalent relative utility (ERU) metric based on signal detection theory to quantify screening performance in such comparisons. The metric is defined as the relative utility, as defined in classical signal detection theory, needed to make 2 systems equivalent. ERU avoids the problem of requiring a predefined putative relative utility, which has limited application of utility theory in receiver operating characteristic analysis. The metric can be readily estimated from recall and detection rates commonly reported in comparative clinical studies. An important practical advantage of ERU is that in prevalence matched populations, the measure can be estimated without an independent estimate of disease prevalence. Thus estimating ERU does not require a study with long-term follow-up to find cases of missed disease. The approach is applicable to any comparative screening study that reports results in terms of recall and detection rates, although the authors focus exclusively on screening mammography in this work. They derive the ERU from the definition of utility given in classical treatments of signal detection theory. They also investigate reasonable values of relative utility in screening mammography for use in interpreting ERU using data from a large clinical study. As examples of application of ERU, they reanalyze 2 recently published reports using recall and detection rates in screening mammography.

KW - Decision Theory

KW - Relative utility

KW - ROC analysis

KW - Screening mammography

UR - http://www.scopus.com/inward/record.url?scp=75949089860&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=75949089860&partnerID=8YFLogxK

U2 - 10.1177/0272989X09341753

DO - 10.1177/0272989X09341753

M3 - Article

C2 - 19706880

AN - SCOPUS:75949089860

VL - 30

SP - 113

EP - 122

JO - Medical Decision Making

JF - Medical Decision Making

SN - 0272-989X

IS - 1

ER -