Observer evaluation of computer-aided detection: second reader versus concurrent reader scenario

Sophie Paquerault; Darin I. Wade; Nicholas Petrick; Kyle J. Myers; Frank W. Samuelson

doi:10.1117/12.707778

8 March 2007 Observer evaluation of computer-aided detection: second reader versus concurrent reader scenario

Sophie Paquerault, Darin I. Wade, Nicholas Petrick, Kyle J. Myers, Frank W. Samuelson

Proceedings Volume 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment; 65151N (2007) https://doi.org/10.1117/12.707778
Event: Medical Imaging, 2007, San Diego, CA, United States

Abstract

We are comparing the performance of computer-aided detection (CAD) used as a second reader to concurrent-use CAD. We have designed a multi-reader multi-case (MRMC) observer study using fixed-size mammographic background images with fixed intensity Gaussian signals added in two experiments. A CAD system was developed to automatically detect these signals. The two experiments utilized signals of different contrast levels to assess the impact of CAD when the standalone CAD sensitivity was superior (low contrast) or equivalent (high contrast) to the average reader in the study. Seven readers participated in the study and were asked to review 100 images, identify signal locations, and rate each on a 100-point scale. A rating of 50 was used as a cutpoint and provided a binary classification of each candidate. Readers read the case set using CAD in both the second-reader and concurrent-reader scenarios. Results from the different signal intensities and reading paradigms were analyzed using the area under the Free-response Receiver Operating Characteristics curves. Sensitivity and the average number of FPs/image were also determined. The results showed that CAD, either used as a second reader or as a concurrent reader, can increase reader sensitivity but with an increase in FPs. The study demonstrated that readers may benefit from concurrent CAD when CAD standalone performance outperforms average reader sensitivity. However, this trend was not observed when CAD performance was equivalent to the sensitivity of the average reader.

Citation Download Citation

Sophie Paquerault, Darin I. Wade, Nicholas Petrick, Kyle J. Myers, and Frank W. Samuelson "Observer evaluation of computer-aided detection: second reader versus concurrent reader scenario", Proc. SPIE 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment, 65151N (8 March 2007); https://doi.org/10.1117/12.707778

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available