Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound

Craig K. Abbey, Roger J. Zemp, Jie Liu, Karen K Lindfors, Michael F. Insana

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The statistical efficiency of human observers in diagnostic tasks is an important measure of how effectively task relevant information in the image is being utilized. Most efficiency studies have investigated efficiency in terms of contrast or size effects. In many cases, malignant lesions will have similar contrast to normal or benign objects, but can be distinguished by properties of their boundary. We investigate this issue in the framework of malignant/benign discrimination tasks for the breast with ultrasound. In order to identify effects in terms of specific features and to control for other effects such as aberration or specular reflections, we simulate the formation of beam-formed radio-frequency (RF) data. We consider three tasks related to lesion boundaries including boundary eccentricity, boundary sharpness, and detection of boundary spiculations. We also consider standard detection and contrast discrimination tasks. We find that human observers exhibit surprisingly low efficiency with respect to the Ideal observer acting on RF data in boundary discrimination tasks (0.08%-3.3%), and that efficiency of human observers is substantially increased by Wiener-filtering RF frame data. We also find a limitation in efficiency is the computation of an envelope image from the RF data recorded by the transducer. Approximations to the Ideal observer acting on the envelope images indicate that humans may be substantially more efficient (10%-75%) with respect to the envelope Ideal observers. Our work suggests that significant diagnostic information may be lost in standard envelope processing in the formation of ultrasonic images.

Original languageEnglish (US)
Title of host publicationProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume6146
DOIs
StatePublished - 2006
EventMedical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment - San Diego, CA, United States
Duration: Feb 14 2006Feb 16 2006

Other

OtherMedical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment
CountryUnited States
CitySan Diego, CA
Period2/14/062/16/06

Fingerprint

Ultrasonics
Aberrations
Transducers
Processing

Keywords

  • Boundary discrimination tasks
  • Breast sonography
  • Ideal observer
  • Observer efficiency

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Abbey, C. K., Zemp, R. J., Liu, J., Lindfors, K. K., & Insana, M. F. (2006). Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE (Vol. 6146). [61460O] https://doi.org/10.1117/12.655731

Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound. / Abbey, Craig K.; Zemp, Roger J.; Liu, Jie; Lindfors, Karen K; Insana, Michael F.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 6146 2006. 61460O.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abbey, CK, Zemp, RJ, Liu, J, Lindfors, KK & Insana, MF 2006, Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound. in Progress in Biomedical Optics and Imaging - Proceedings of SPIE. vol. 6146, 61460O, Medical Imaging 2006: Image Perception, Observer Performance, and Technology Assessment, San Diego, CA, United States, 2/14/06. https://doi.org/10.1117/12.655731
Abbey CK, Zemp RJ, Liu J, Lindfors KK, Insana MF. Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 6146. 2006. 61460O https://doi.org/10.1117/12.655731
Abbey, Craig K. ; Zemp, Roger J. ; Liu, Jie ; Lindfors, Karen K ; Insana, Michael F. / Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound. Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 6146 2006.
@inproceedings{c1fda0c9197745e59dab73712fe0de0a,
title = "Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound",
abstract = "The statistical efficiency of human observers in diagnostic tasks is an important measure of how effectively task relevant information in the image is being utilized. Most efficiency studies have investigated efficiency in terms of contrast or size effects. In many cases, malignant lesions will have similar contrast to normal or benign objects, but can be distinguished by properties of their boundary. We investigate this issue in the framework of malignant/benign discrimination tasks for the breast with ultrasound. In order to identify effects in terms of specific features and to control for other effects such as aberration or specular reflections, we simulate the formation of beam-formed radio-frequency (RF) data. We consider three tasks related to lesion boundaries including boundary eccentricity, boundary sharpness, and detection of boundary spiculations. We also consider standard detection and contrast discrimination tasks. We find that human observers exhibit surprisingly low efficiency with respect to the Ideal observer acting on RF data in boundary discrimination tasks (0.08{\%}-3.3{\%}), and that efficiency of human observers is substantially increased by Wiener-filtering RF frame data. We also find a limitation in efficiency is the computation of an envelope image from the RF data recorded by the transducer. Approximations to the Ideal observer acting on the envelope images indicate that humans may be substantially more efficient (10{\%}-75{\%}) with respect to the envelope Ideal observers. Our work suggests that significant diagnostic information may be lost in standard envelope processing in the formation of ultrasonic images.",
keywords = "Boundary discrimination tasks, Breast sonography, Ideal observer, Observer efficiency",
author = "Abbey, {Craig K.} and Zemp, {Roger J.} and Jie Liu and Lindfors, {Karen K} and Insana, {Michael F.}",
year = "2006",
doi = "10.1117/12.655731",
language = "English (US)",
isbn = "0819464252",
volume = "6146",
booktitle = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",

}

TY - GEN

T1 - Observer efficiency in boundary discrimination tasks related to assessment of breast lesions with ultrasound

AU - Abbey, Craig K.

AU - Zemp, Roger J.

AU - Liu, Jie

AU - Lindfors, Karen K

AU - Insana, Michael F.

PY - 2006

Y1 - 2006

N2 - The statistical efficiency of human observers in diagnostic tasks is an important measure of how effectively task relevant information in the image is being utilized. Most efficiency studies have investigated efficiency in terms of contrast or size effects. In many cases, malignant lesions will have similar contrast to normal or benign objects, but can be distinguished by properties of their boundary. We investigate this issue in the framework of malignant/benign discrimination tasks for the breast with ultrasound. In order to identify effects in terms of specific features and to control for other effects such as aberration or specular reflections, we simulate the formation of beam-formed radio-frequency (RF) data. We consider three tasks related to lesion boundaries including boundary eccentricity, boundary sharpness, and detection of boundary spiculations. We also consider standard detection and contrast discrimination tasks. We find that human observers exhibit surprisingly low efficiency with respect to the Ideal observer acting on RF data in boundary discrimination tasks (0.08%-3.3%), and that efficiency of human observers is substantially increased by Wiener-filtering RF frame data. We also find a limitation in efficiency is the computation of an envelope image from the RF data recorded by the transducer. Approximations to the Ideal observer acting on the envelope images indicate that humans may be substantially more efficient (10%-75%) with respect to the envelope Ideal observers. Our work suggests that significant diagnostic information may be lost in standard envelope processing in the formation of ultrasonic images.

AB - The statistical efficiency of human observers in diagnostic tasks is an important measure of how effectively task relevant information in the image is being utilized. Most efficiency studies have investigated efficiency in terms of contrast or size effects. In many cases, malignant lesions will have similar contrast to normal or benign objects, but can be distinguished by properties of their boundary. We investigate this issue in the framework of malignant/benign discrimination tasks for the breast with ultrasound. In order to identify effects in terms of specific features and to control for other effects such as aberration or specular reflections, we simulate the formation of beam-formed radio-frequency (RF) data. We consider three tasks related to lesion boundaries including boundary eccentricity, boundary sharpness, and detection of boundary spiculations. We also consider standard detection and contrast discrimination tasks. We find that human observers exhibit surprisingly low efficiency with respect to the Ideal observer acting on RF data in boundary discrimination tasks (0.08%-3.3%), and that efficiency of human observers is substantially increased by Wiener-filtering RF frame data. We also find a limitation in efficiency is the computation of an envelope image from the RF data recorded by the transducer. Approximations to the Ideal observer acting on the envelope images indicate that humans may be substantially more efficient (10%-75%) with respect to the envelope Ideal observers. Our work suggests that significant diagnostic information may be lost in standard envelope processing in the formation of ultrasonic images.

KW - Boundary discrimination tasks

KW - Breast sonography

KW - Ideal observer

KW - Observer efficiency

UR - http://www.scopus.com/inward/record.url?scp=33745140871&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745140871&partnerID=8YFLogxK

U2 - 10.1117/12.655731

DO - 10.1117/12.655731

M3 - Conference contribution

AN - SCOPUS:33745140871

SN - 0819464252

SN - 9780819464255

VL - 6146

BT - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

ER -