Reproducibility of BI-RADS breast density measures among community radiologists

A prospective cohort study

Mary C. Spayne, Charlotte C. Gard, Joan Skelly, Diana L Miglioretti, Pamela M. Vacek, Berta M. Geller

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

Using data from the Vermont Breast Cancer Surveillance System (VBCSS), we studied the reproducibility of Breast Imaging Reporting and Data System (BI-RADS) breast density among community radiologists interpreting mammograms in a cohort of 11,755 postmenopausal women. Radiologists interpreting two or more film-screen screening or bilateral diagnostic mammograms for the same woman within a 3- to 24-month period during 1996-2006 were eligible. We observed moderate-to-substantial overall intra-rater agreement for use of BI-RADS breast density in clinical practice, with an overall intra-radiologist percent agreement of 77.2% (95% confidence interval (CI), 74.5-79.5%), an overall simple kappa of 0.58 (95% CI, 0.55-0.61), and an overall weighted kappa of 0.70 (95% CI, 0.68-0.73). Agreement exhibited by individual radiologists varied widely, with intra-radiologist percent agreement ranging from 62.1% to 87.4% and simple kappa ranging from 0.19 to 0.69 across individual radiologists. Our findings underscore the need for additional evaluation of the BI-RADS breast density categorization system in clinical practice.

Original languageEnglish (US)
Pages (from-to)326-333
Number of pages8
JournalBreast Journal
Volume18
Issue number4
DOIs
StatePublished - Jul 2012
Externally publishedYes

Fingerprint

Information Systems
Breast
Cohort Studies
Prospective Studies
Confidence Intervals
Motion Pictures
Radiologists
Breast Density
Breast Neoplasms

Keywords

  • BI-RADS breast density
  • clinical practice
  • intra-radiologist agreement
  • mammography

ASJC Scopus subject areas

  • Internal Medicine
  • Oncology
  • Surgery

Cite this

Reproducibility of BI-RADS breast density measures among community radiologists : A prospective cohort study. / Spayne, Mary C.; Gard, Charlotte C.; Skelly, Joan; Miglioretti, Diana L; Vacek, Pamela M.; Geller, Berta M.

In: Breast Journal, Vol. 18, No. 4, 07.2012, p. 326-333.

Research output: Contribution to journalArticle

Spayne, Mary C. ; Gard, Charlotte C. ; Skelly, Joan ; Miglioretti, Diana L ; Vacek, Pamela M. ; Geller, Berta M. / Reproducibility of BI-RADS breast density measures among community radiologists : A prospective cohort study. In: Breast Journal. 2012 ; Vol. 18, No. 4. pp. 326-333.
@article{0352866e8fe94cd78482afa66aa3fbb4,
title = "Reproducibility of BI-RADS breast density measures among community radiologists: A prospective cohort study",
abstract = "Using data from the Vermont Breast Cancer Surveillance System (VBCSS), we studied the reproducibility of Breast Imaging Reporting and Data System (BI-RADS) breast density among community radiologists interpreting mammograms in a cohort of 11,755 postmenopausal women. Radiologists interpreting two or more film-screen screening or bilateral diagnostic mammograms for the same woman within a 3- to 24-month period during 1996-2006 were eligible. We observed moderate-to-substantial overall intra-rater agreement for use of BI-RADS breast density in clinical practice, with an overall intra-radiologist percent agreement of 77.2{\%} (95{\%} confidence interval (CI), 74.5-79.5{\%}), an overall simple kappa of 0.58 (95{\%} CI, 0.55-0.61), and an overall weighted kappa of 0.70 (95{\%} CI, 0.68-0.73). Agreement exhibited by individual radiologists varied widely, with intra-radiologist percent agreement ranging from 62.1{\%} to 87.4{\%} and simple kappa ranging from 0.19 to 0.69 across individual radiologists. Our findings underscore the need for additional evaluation of the BI-RADS breast density categorization system in clinical practice.",
keywords = "BI-RADS breast density, clinical practice, intra-radiologist agreement, mammography",
author = "Spayne, {Mary C.} and Gard, {Charlotte C.} and Joan Skelly and Miglioretti, {Diana L} and Vacek, {Pamela M.} and Geller, {Berta M.}",
year = "2012",
month = "7",
doi = "10.1111/j.1524-4741.2012.01250.x",
language = "English (US)",
volume = "18",
pages = "326--333",
journal = "Breast Journal",
issn = "1075-122X",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - Reproducibility of BI-RADS breast density measures among community radiologists

T2 - A prospective cohort study

AU - Spayne, Mary C.

AU - Gard, Charlotte C.

AU - Skelly, Joan

AU - Miglioretti, Diana L

AU - Vacek, Pamela M.

AU - Geller, Berta M.

PY - 2012/7

Y1 - 2012/7

N2 - Using data from the Vermont Breast Cancer Surveillance System (VBCSS), we studied the reproducibility of Breast Imaging Reporting and Data System (BI-RADS) breast density among community radiologists interpreting mammograms in a cohort of 11,755 postmenopausal women. Radiologists interpreting two or more film-screen screening or bilateral diagnostic mammograms for the same woman within a 3- to 24-month period during 1996-2006 were eligible. We observed moderate-to-substantial overall intra-rater agreement for use of BI-RADS breast density in clinical practice, with an overall intra-radiologist percent agreement of 77.2% (95% confidence interval (CI), 74.5-79.5%), an overall simple kappa of 0.58 (95% CI, 0.55-0.61), and an overall weighted kappa of 0.70 (95% CI, 0.68-0.73). Agreement exhibited by individual radiologists varied widely, with intra-radiologist percent agreement ranging from 62.1% to 87.4% and simple kappa ranging from 0.19 to 0.69 across individual radiologists. Our findings underscore the need for additional evaluation of the BI-RADS breast density categorization system in clinical practice.

AB - Using data from the Vermont Breast Cancer Surveillance System (VBCSS), we studied the reproducibility of Breast Imaging Reporting and Data System (BI-RADS) breast density among community radiologists interpreting mammograms in a cohort of 11,755 postmenopausal women. Radiologists interpreting two or more film-screen screening or bilateral diagnostic mammograms for the same woman within a 3- to 24-month period during 1996-2006 were eligible. We observed moderate-to-substantial overall intra-rater agreement for use of BI-RADS breast density in clinical practice, with an overall intra-radiologist percent agreement of 77.2% (95% confidence interval (CI), 74.5-79.5%), an overall simple kappa of 0.58 (95% CI, 0.55-0.61), and an overall weighted kappa of 0.70 (95% CI, 0.68-0.73). Agreement exhibited by individual radiologists varied widely, with intra-radiologist percent agreement ranging from 62.1% to 87.4% and simple kappa ranging from 0.19 to 0.69 across individual radiologists. Our findings underscore the need for additional evaluation of the BI-RADS breast density categorization system in clinical practice.

KW - BI-RADS breast density

KW - clinical practice

KW - intra-radiologist agreement

KW - mammography

UR - http://www.scopus.com/inward/record.url?scp=84863717496&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863717496&partnerID=8YFLogxK

U2 - 10.1111/j.1524-4741.2012.01250.x

DO - 10.1111/j.1524-4741.2012.01250.x

M3 - Article

VL - 18

SP - 326

EP - 333

JO - Breast Journal

JF - Breast Journal

SN - 1075-122X

IS - 4

ER -