Association between time spent interpreting, level of confidence, and accuracy of screening mammography

Patricia A. Carney, T. Andrew Bogart, Berta M. Geller, Sebastian Haneuse, Karla Kerlikowske, Diana S M Buist, Robert Smith, Robert Rosenberg, Bonnie C. Yankaskas, Tracy Onega, Diana L Miglioretti

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

OBJECTIVE. The objective of this study was to examine the effect of time spent viewing images and level of confidence on a screening mammography test set on interpretive performance. MATERIALS AND METHODS. Radiologists from six mammography registries participated in this study and were randomized to interpret one of four test sets and complete 12 survey questions. Each test set had 109 cases of digitized four-view screening screen-film mammograms with prior comparison screening views. Viewing time for each case was defined as the cumulative time spent viewing all mammographic images before recording which visible feature, if any, was the "most significant finding." Log-linear regression fit via the generalized estimating equation was used to test the effect of viewing time and level of confidence in the interpretation on test set sensitivity and false-positive rate. RESULTS. One hundred nineteen radiologists completed a test set and contributed data on 11,484 interpretations. The radiologists spent more time viewing cases that had significant findings or cases for which they had less confidence in their interpretation. Each additional minute of viewing time increased the probability of a true-positive interpretation among cancer cases by 1.12 (95% CI, 1.06-1.19; p < 0.001) regardless of confidence in the assessment. Among the radiologists who were very confident in their assessment, each additional minute of viewing time increased the adjusted risk of a false-positive interpretation among noncancer cases by 1.42 (95% CI, 1.21-1.68), and this viewing-time effect diminished with decreasing confidence. CONCLUSION. Longer interpretation times and higher levels of confidence in an interpretation are both associated with higher sensitivity and false-positive rates in mammography screening.

Original languageEnglish (US)
Pages (from-to)970-978
Number of pages9
JournalAmerican Journal of Roentgenology
Volume198
Issue number4
DOIs
StatePublished - Apr 2012
Externally publishedYes

Fingerprint

Mammography
Registries
Linear Models
Radiologists

Keywords

  • Breast cancer
  • Breast imaging
  • Interpreter performance
  • Screening mammography

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Association between time spent interpreting, level of confidence, and accuracy of screening mammography. / Carney, Patricia A.; Bogart, T. Andrew; Geller, Berta M.; Haneuse, Sebastian; Kerlikowske, Karla; Buist, Diana S M; Smith, Robert; Rosenberg, Robert; Yankaskas, Bonnie C.; Onega, Tracy; Miglioretti, Diana L.

In: American Journal of Roentgenology, Vol. 198, No. 4, 04.2012, p. 970-978.

Research output: Contribution to journalArticle

Carney, PA, Bogart, TA, Geller, BM, Haneuse, S, Kerlikowske, K, Buist, DSM, Smith, R, Rosenberg, R, Yankaskas, BC, Onega, T & Miglioretti, DL 2012, 'Association between time spent interpreting, level of confidence, and accuracy of screening mammography', American Journal of Roentgenology, vol. 198, no. 4, pp. 970-978. https://doi.org/10.2214/AJR.11.6988
Carney, Patricia A. ; Bogart, T. Andrew ; Geller, Berta M. ; Haneuse, Sebastian ; Kerlikowske, Karla ; Buist, Diana S M ; Smith, Robert ; Rosenberg, Robert ; Yankaskas, Bonnie C. ; Onega, Tracy ; Miglioretti, Diana L. / Association between time spent interpreting, level of confidence, and accuracy of screening mammography. In: American Journal of Roentgenology. 2012 ; Vol. 198, No. 4. pp. 970-978.
@article{6e4f963b086440f0a8af76b25d10692b,
title = "Association between time spent interpreting, level of confidence, and accuracy of screening mammography",
abstract = "OBJECTIVE. The objective of this study was to examine the effect of time spent viewing images and level of confidence on a screening mammography test set on interpretive performance. MATERIALS AND METHODS. Radiologists from six mammography registries participated in this study and were randomized to interpret one of four test sets and complete 12 survey questions. Each test set had 109 cases of digitized four-view screening screen-film mammograms with prior comparison screening views. Viewing time for each case was defined as the cumulative time spent viewing all mammographic images before recording which visible feature, if any, was the {"}most significant finding.{"} Log-linear regression fit via the generalized estimating equation was used to test the effect of viewing time and level of confidence in the interpretation on test set sensitivity and false-positive rate. RESULTS. One hundred nineteen radiologists completed a test set and contributed data on 11,484 interpretations. The radiologists spent more time viewing cases that had significant findings or cases for which they had less confidence in their interpretation. Each additional minute of viewing time increased the probability of a true-positive interpretation among cancer cases by 1.12 (95{\%} CI, 1.06-1.19; p < 0.001) regardless of confidence in the assessment. Among the radiologists who were very confident in their assessment, each additional minute of viewing time increased the adjusted risk of a false-positive interpretation among noncancer cases by 1.42 (95{\%} CI, 1.21-1.68), and this viewing-time effect diminished with decreasing confidence. CONCLUSION. Longer interpretation times and higher levels of confidence in an interpretation are both associated with higher sensitivity and false-positive rates in mammography screening.",
keywords = "Breast cancer, Breast imaging, Interpreter performance, Screening mammography",
author = "Carney, {Patricia A.} and Bogart, {T. Andrew} and Geller, {Berta M.} and Sebastian Haneuse and Karla Kerlikowske and Buist, {Diana S M} and Robert Smith and Robert Rosenberg and Yankaskas, {Bonnie C.} and Tracy Onega and Miglioretti, {Diana L}",
year = "2012",
month = "4",
doi = "10.2214/AJR.11.6988",
language = "English (US)",
volume = "198",
pages = "970--978",
journal = "American Journal of Roentgenology",
issn = "0361-803X",
publisher = "American Roentgen Ray Society",
number = "4",

}

TY - JOUR

T1 - Association between time spent interpreting, level of confidence, and accuracy of screening mammography

AU - Carney, Patricia A.

AU - Bogart, T. Andrew

AU - Geller, Berta M.

AU - Haneuse, Sebastian

AU - Kerlikowske, Karla

AU - Buist, Diana S M

AU - Smith, Robert

AU - Rosenberg, Robert

AU - Yankaskas, Bonnie C.

AU - Onega, Tracy

AU - Miglioretti, Diana L

PY - 2012/4

Y1 - 2012/4

N2 - OBJECTIVE. The objective of this study was to examine the effect of time spent viewing images and level of confidence on a screening mammography test set on interpretive performance. MATERIALS AND METHODS. Radiologists from six mammography registries participated in this study and were randomized to interpret one of four test sets and complete 12 survey questions. Each test set had 109 cases of digitized four-view screening screen-film mammograms with prior comparison screening views. Viewing time for each case was defined as the cumulative time spent viewing all mammographic images before recording which visible feature, if any, was the "most significant finding." Log-linear regression fit via the generalized estimating equation was used to test the effect of viewing time and level of confidence in the interpretation on test set sensitivity and false-positive rate. RESULTS. One hundred nineteen radiologists completed a test set and contributed data on 11,484 interpretations. The radiologists spent more time viewing cases that had significant findings or cases for which they had less confidence in their interpretation. Each additional minute of viewing time increased the probability of a true-positive interpretation among cancer cases by 1.12 (95% CI, 1.06-1.19; p < 0.001) regardless of confidence in the assessment. Among the radiologists who were very confident in their assessment, each additional minute of viewing time increased the adjusted risk of a false-positive interpretation among noncancer cases by 1.42 (95% CI, 1.21-1.68), and this viewing-time effect diminished with decreasing confidence. CONCLUSION. Longer interpretation times and higher levels of confidence in an interpretation are both associated with higher sensitivity and false-positive rates in mammography screening.

AB - OBJECTIVE. The objective of this study was to examine the effect of time spent viewing images and level of confidence on a screening mammography test set on interpretive performance. MATERIALS AND METHODS. Radiologists from six mammography registries participated in this study and were randomized to interpret one of four test sets and complete 12 survey questions. Each test set had 109 cases of digitized four-view screening screen-film mammograms with prior comparison screening views. Viewing time for each case was defined as the cumulative time spent viewing all mammographic images before recording which visible feature, if any, was the "most significant finding." Log-linear regression fit via the generalized estimating equation was used to test the effect of viewing time and level of confidence in the interpretation on test set sensitivity and false-positive rate. RESULTS. One hundred nineteen radiologists completed a test set and contributed data on 11,484 interpretations. The radiologists spent more time viewing cases that had significant findings or cases for which they had less confidence in their interpretation. Each additional minute of viewing time increased the probability of a true-positive interpretation among cancer cases by 1.12 (95% CI, 1.06-1.19; p < 0.001) regardless of confidence in the assessment. Among the radiologists who were very confident in their assessment, each additional minute of viewing time increased the adjusted risk of a false-positive interpretation among noncancer cases by 1.42 (95% CI, 1.21-1.68), and this viewing-time effect diminished with decreasing confidence. CONCLUSION. Longer interpretation times and higher levels of confidence in an interpretation are both associated with higher sensitivity and false-positive rates in mammography screening.

KW - Breast cancer

KW - Breast imaging

KW - Interpreter performance

KW - Screening mammography

UR - http://www.scopus.com/inward/record.url?scp=84859121225&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859121225&partnerID=8YFLogxK

U2 - 10.2214/AJR.11.6988

DO - 10.2214/AJR.11.6988

M3 - Article

C2 - 22451568

AN - SCOPUS:84859121225

VL - 198

SP - 970

EP - 978

JO - American Journal of Roentgenology

JF - American Journal of Roentgenology

SN - 0361-803X

IS - 4

ER -