Comparing signal-based and case-based methodologies for CAD assessment in a detection task

Sophie Paquerault; Frank W. Samuelson; Nicholas Petrick; Kyle J. Myers

doi:10.1117/12.771498

24 March 2008 Comparing signal-based and case-based methodologies for CAD assessment in a detection task

Sophie Paquerault, Frank W. Samuelson, Nicholas Petrick, Kyle J. Myers

Proceedings Volume 6917, Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment; 691708 (2008) https://doi.org/10.1117/12.771498
Event: Medical Imaging, 2008, San Diego, California, United States

Abstract

We are investigating the potential for differences in study conclusions when assessing the estimated impact of a computer-aided detection (CAD) system on readers' performance using a signal-based performance analysis derived from Free-response Receiver Operating Characteristics (FROC) versus a case-based performance analysis derived from Receiver Operating Characteristics (ROC) analysis. To consider this question, we utilized reader data from a CAD assessment study based on 100 mammographic background images to which fixed-size and fixed-intensity Gaussian signals were added, generating a low- and high-intensity set. The study thus allowed CAD assessment in two situations: when CAD sensitivity was 1) superior or 2) equivalent or lower than the average reader. Seven readers were asked to review each set using CAD in both second-reader and concurrent modes. Signal-based detection results were analyzed using the area under the FROC curve below 0.5 false positives per image. Case-based decision results were analyzed using the area under the parametric ROC curve. The results were consistent between the signal-based and case-based analyses for the low-intensity set, suggesting that CAD in both reading modes can increase reader signal-based detection and case-based decision accuracies. For the high-intensity set, the signal-based and case-based analysis suggested different conclusions regarding the utility of CAD, although neither analysis resulted in statistical significance.

Citation Download Citation

Sophie Paquerault, Frank W. Samuelson, Nicholas Petrick, and Kyle J. Myers "Comparing signal-based and case-based methodologies for CAD assessment in a detection task", Proc. SPIE 6917, Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment, 691708 (24 March 2008); https://doi.org/10.1117/12.771498

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available