Poster + Paper
29 March 2024 Modeling decision making in breast cancer screening using deep learning: usability of a Gabor convolutional layer
Author Affiliations +
Conference Poster
Abstract
This study focuses on investigating radiologists' decision-making processes in breast cancer screening, with the aim of exploring the potential of a decision prediction model trained using individual radiologists' decisions. We built decision prediction models based on the radiologists' eye position recordings and the locations where they indicated that a malignant mass was present. We considered 120 mammogram cases read by eight radiologists with different expertise levels. The decisions made were classified into three categories: True Positives (TP), False Negatives (FN), and False Positives (FP), based on the radiologists' marks and the ground truth. Notably, the data for each radiologist was used to train independent radiologist specific models. The marked areas (TPs, FPs) and the False Negative areas were cropped and fed into both base models VGG19 and ResNet50, which were pretrained with the ImageNet dataset. We enhanced both base models by incorporating a Gabor filter layer. The Gabor filter layer, implemented as a 2D convolutional layer with fixed weights, utilizes Gabor filters to extract essential Gabor features from the input. As a result, our approach yields four models tailored for decision prediction for each radiologist – VGG19 and ResNet50 each with and without Gabor filters. The models were analyzed and compared to assess their performance and potential benefits. The results underscored the significance of the radiologist's expertise and consistency in making decisions in determining the model's accuracy. When radiologists' responses are inconsistent regarding similar features across different cases, predicting the decisions using the individual models becomes challenging. Consequently, the models’ performance displayed variation based on individual radiologists’ data.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Karthika Kelat, Sarah E. Gerard, and Claudia Mello-Thoms "Modeling decision making in breast cancer screening using deep learning: usability of a Gabor convolutional layer", Proc. SPIE 12929, Medical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment, 1292914 (29 March 2024); https://doi.org/10.1117/12.3008759
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Breast cancer

Data modeling

Mammography

Eye models

Decision making

Deep learning

Back to Top