An equivalent relative utility metric for evaluating screening mammography

Craig K. Abbey, Miguel P. Eckstein, John M Boone

Research output: Contribution to journalArticle

18 Scopus citations

Abstract

Comparative studies of performance in screening mammography are often ambiguous. A new method will frequently show a higher sensitivity or detection rate than an existing standard with a concomitant increase in false positives or recalls. The authors propose an equivalent relative utility (ERU) metric based on signal detection theory to quantify screening performance in such comparisons. The metric is defined as the relative utility, as defined in classical signal detection theory, needed to make 2 systems equivalent. ERU avoids the problem of requiring a predefined putative relative utility, which has limited application of utility theory in receiver operating characteristic analysis. The metric can be readily estimated from recall and detection rates commonly reported in comparative clinical studies. An important practical advantage of ERU is that in prevalence matched populations, the measure can be estimated without an independent estimate of disease prevalence. Thus estimating ERU does not require a study with long-term follow-up to find cases of missed disease. The approach is applicable to any comparative screening study that reports results in terms of recall and detection rates, although the authors focus exclusively on screening mammography in this work. They derive the ERU from the definition of utility given in classical treatments of signal detection theory. They also investigate reasonable values of relative utility in screening mammography for use in interpreting ERU using data from a large clinical study. As examples of application of ERU, they reanalyze 2 recently published reports using recall and detection rates in screening mammography.

Original languageEnglish (US)
Pages (from-to)113-122
Number of pages10
JournalMedical Decision Making
Volume30
Issue number1
DOIs
StatePublished - Jan 2010

Keywords

  • Decision Theory
  • Relative utility
  • ROC analysis
  • Screening mammography

ASJC Scopus subject areas

  • Health Policy
  • Medicine(all)

Fingerprint Dive into the research topics of 'An equivalent relative utility metric for evaluating screening mammography'. Together they form a unique fingerprint.

  • Cite this