Using BIRADS categories in ROC experiments

Maria Kallergi; Marla R. Hersh; Jerry A. Thomas

doi:10.1117/12.462701

12 April 2002 Using BIRADS categories in ROC experiments

Maria Kallergi, Marla R. Hersh, Jerry A. Thomas

Proceedings Volume 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment; (2002) https://doi.org/10.1117/12.462701
Event: Medical Imaging 2002, 2002, San Diego, California, United States

Abstract

This paper investigated the use of the Breast Imaging Reporting And Data System (BIRADS) Lexicon in ROC mammography experiments. Analysis was based on data from parallel ROC experiments performed at two Institutions with different readers and databases to compare film to digitized mammography. Seven readers participated in the studies and read approximately 200 cases each in two formats: film and digital or softcopy. Reporting was done using BIRADS categories 1 through 5. Training was done with a separate set of cases and included detailed review of the relationship between BIRADS and a standard ROC discrete 5-point rating scale. The results from both sites showed equivalency between film and softcopy mammography. Decisions using the BIRADS categories showed no unsampled ROC regions and no degenerate data. Fits yielded smooth ROC curves that correlated to clinical practice. In a qualitative evaluation, all observers indicated preference in using the BIRADS classes instead of a discrete or continuous rating scheme. Familiarity with the rating process seems to relieve some of the bias associated with the interpretation of digitized mammograms from computer monitors (softcopy reading). Our results suggested that BIRADS categories can be used in comparative ROC studies because they represent a scale familiar to the reader that can be followed consistently and they provide a rating approach that accounts for both positive and negative cases to be evaluated and categorized.

Citation Download Citation

Maria Kallergi, Marla R. Hersh, and Jerry A. Thomas "Using BIRADS categories in ROC experiments", Proc. SPIE 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment, (12 April 2002); https://doi.org/10.1117/12.462701

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available