Relationship between computer segmentation performance and computer classification performance in breast CT: A simulation study using RGI segmentation and LDA classification

Juhun Lee, Robert M. Nishikawa, Ingrid Reiser, John M Boone

Research output: Contribution to journalArticle

Abstract

Purpose: Many computer aided diagnosis (CADx) tools for breast cancer begin by fully or semiautomatically segmenting a given breast lesion and then classifying the lesion's likelihood of malignancy using quantitative features extracted from the image. It is often assumed that better segmentation will result in better classification. However, this has not been thoroughly evaluated. The purpose of this study is to evaluate the relationship between computer segmentation performance and computer classification performance. Method: We used 85 breast lesions (32 benign, 56 malignant) from breast computed tomography (CT) cases of 82 women. We prepared one smooth and one sharp iterative image reconstructions (IIR) and a clinical reconstruction for each of the 82 breast CT scans. For each reconstruction, we created 15 segmentation outcomes by applying 15 different segmentation algorithms. Specifically, we simulated 15 segmentation algorithms by changing parameters in a single segmentation algorithm. We then created 15 classification outcomes by conducting quantitative image feature analysis on the segmented image results. Using a 10-fold cross-validation, we evaluated the relationship between segmentation and classification performances. Result: We found a low positive correlation between segmentation and classification performances for the smooth IIR (median Pearson's rho = 0.18), while a moderate positive correlation (median Pearson's rho = 0.4-0.43) was found between the two performances for the sharp IIR and clinical reconstruction. However, we found large variations in both segmentation and classification performances for the sharp IIR and clinical reconstruction. There were cases where segmentation algorithms resulted in similar segmentation performances, but the corresponding classification performances were different. These results indicate that an improvement in segmentation performance does not guarantee an improvement in the corresponding classification performance. Conclusion: Computer segmentation is an indirect variable affecting the computer classification. As better segmentation does not guarantee better classification, we should report both segmentation and classification performances when comparing segmentation algorithms.

Original languageEnglish (US)
JournalMedical Physics
DOIs
StateAccepted/In press - Jan 1 2018

Fingerprint

Breast
Tomography
Computer-Assisted Image Processing
Breast Neoplasms

Keywords

  • Breast CT
  • Computer classification
  • Computer segmentation
  • Computer-aided diagnosis

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Cite this

@article{8a975384e8824437a6542c8d9f27bd1d,
title = "Relationship between computer segmentation performance and computer classification performance in breast CT: A simulation study using RGI segmentation and LDA classification",
abstract = "Purpose: Many computer aided diagnosis (CADx) tools for breast cancer begin by fully or semiautomatically segmenting a given breast lesion and then classifying the lesion's likelihood of malignancy using quantitative features extracted from the image. It is often assumed that better segmentation will result in better classification. However, this has not been thoroughly evaluated. The purpose of this study is to evaluate the relationship between computer segmentation performance and computer classification performance. Method: We used 85 breast lesions (32 benign, 56 malignant) from breast computed tomography (CT) cases of 82 women. We prepared one smooth and one sharp iterative image reconstructions (IIR) and a clinical reconstruction for each of the 82 breast CT scans. For each reconstruction, we created 15 segmentation outcomes by applying 15 different segmentation algorithms. Specifically, we simulated 15 segmentation algorithms by changing parameters in a single segmentation algorithm. We then created 15 classification outcomes by conducting quantitative image feature analysis on the segmented image results. Using a 10-fold cross-validation, we evaluated the relationship between segmentation and classification performances. Result: We found a low positive correlation between segmentation and classification performances for the smooth IIR (median Pearson's rho = 0.18), while a moderate positive correlation (median Pearson's rho = 0.4-0.43) was found between the two performances for the sharp IIR and clinical reconstruction. However, we found large variations in both segmentation and classification performances for the sharp IIR and clinical reconstruction. There were cases where segmentation algorithms resulted in similar segmentation performances, but the corresponding classification performances were different. These results indicate that an improvement in segmentation performance does not guarantee an improvement in the corresponding classification performance. Conclusion: Computer segmentation is an indirect variable affecting the computer classification. As better segmentation does not guarantee better classification, we should report both segmentation and classification performances when comparing segmentation algorithms.",
keywords = "Breast CT, Computer classification, Computer segmentation, Computer-aided diagnosis",
author = "Juhun Lee and Nishikawa, {Robert M.} and Ingrid Reiser and Boone, {John M}",
year = "2018",
month = "1",
day = "1",
doi = "10.1002/mp.13054",
language = "English (US)",
journal = "Medical Physics",
issn = "0094-2405",
publisher = "AAPM - American Association of Physicists in Medicine",

}

TY - JOUR

T1 - Relationship between computer segmentation performance and computer classification performance in breast CT

T2 - A simulation study using RGI segmentation and LDA classification

AU - Lee, Juhun

AU - Nishikawa, Robert M.

AU - Reiser, Ingrid

AU - Boone, John M

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Purpose: Many computer aided diagnosis (CADx) tools for breast cancer begin by fully or semiautomatically segmenting a given breast lesion and then classifying the lesion's likelihood of malignancy using quantitative features extracted from the image. It is often assumed that better segmentation will result in better classification. However, this has not been thoroughly evaluated. The purpose of this study is to evaluate the relationship between computer segmentation performance and computer classification performance. Method: We used 85 breast lesions (32 benign, 56 malignant) from breast computed tomography (CT) cases of 82 women. We prepared one smooth and one sharp iterative image reconstructions (IIR) and a clinical reconstruction for each of the 82 breast CT scans. For each reconstruction, we created 15 segmentation outcomes by applying 15 different segmentation algorithms. Specifically, we simulated 15 segmentation algorithms by changing parameters in a single segmentation algorithm. We then created 15 classification outcomes by conducting quantitative image feature analysis on the segmented image results. Using a 10-fold cross-validation, we evaluated the relationship between segmentation and classification performances. Result: We found a low positive correlation between segmentation and classification performances for the smooth IIR (median Pearson's rho = 0.18), while a moderate positive correlation (median Pearson's rho = 0.4-0.43) was found between the two performances for the sharp IIR and clinical reconstruction. However, we found large variations in both segmentation and classification performances for the sharp IIR and clinical reconstruction. There were cases where segmentation algorithms resulted in similar segmentation performances, but the corresponding classification performances were different. These results indicate that an improvement in segmentation performance does not guarantee an improvement in the corresponding classification performance. Conclusion: Computer segmentation is an indirect variable affecting the computer classification. As better segmentation does not guarantee better classification, we should report both segmentation and classification performances when comparing segmentation algorithms.

AB - Purpose: Many computer aided diagnosis (CADx) tools for breast cancer begin by fully or semiautomatically segmenting a given breast lesion and then classifying the lesion's likelihood of malignancy using quantitative features extracted from the image. It is often assumed that better segmentation will result in better classification. However, this has not been thoroughly evaluated. The purpose of this study is to evaluate the relationship between computer segmentation performance and computer classification performance. Method: We used 85 breast lesions (32 benign, 56 malignant) from breast computed tomography (CT) cases of 82 women. We prepared one smooth and one sharp iterative image reconstructions (IIR) and a clinical reconstruction for each of the 82 breast CT scans. For each reconstruction, we created 15 segmentation outcomes by applying 15 different segmentation algorithms. Specifically, we simulated 15 segmentation algorithms by changing parameters in a single segmentation algorithm. We then created 15 classification outcomes by conducting quantitative image feature analysis on the segmented image results. Using a 10-fold cross-validation, we evaluated the relationship between segmentation and classification performances. Result: We found a low positive correlation between segmentation and classification performances for the smooth IIR (median Pearson's rho = 0.18), while a moderate positive correlation (median Pearson's rho = 0.4-0.43) was found between the two performances for the sharp IIR and clinical reconstruction. However, we found large variations in both segmentation and classification performances for the sharp IIR and clinical reconstruction. There were cases where segmentation algorithms resulted in similar segmentation performances, but the corresponding classification performances were different. These results indicate that an improvement in segmentation performance does not guarantee an improvement in the corresponding classification performance. Conclusion: Computer segmentation is an indirect variable affecting the computer classification. As better segmentation does not guarantee better classification, we should report both segmentation and classification performances when comparing segmentation algorithms.

KW - Breast CT

KW - Computer classification

KW - Computer segmentation

KW - Computer-aided diagnosis

UR - http://www.scopus.com/inward/record.url?scp=85050594463&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050594463&partnerID=8YFLogxK

U2 - 10.1002/mp.13054

DO - 10.1002/mp.13054

M3 - Article

AN - SCOPUS:85050594463

JO - Medical Physics

JF - Medical Physics

SN - 0094-2405

ER -