Deciphering deep ensembles for lung nodule analysis

Ravi K. Samala; Berkman Sahiner; Gene Pennello; Kenny H. Cha; Mohammad Mehdi Farhangi; Nicholas Petrick

doi:10.1117/12.2612023

4 April 2022 Deciphering deep ensembles for lung nodule analysis

Ravi K. Samala, Berkman Sahiner, Gene Pennello, Kenny H. Cha, Mohammad Mehdi Farhangi, Nicholas Petrick

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 120330L (2022) https://doi.org/10.1117/12.2612023
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Empirical ensembles of deep convolutional neural network (DNN) models have been shown to outperform individual DNN models as seen in the last few ImageNet challenges. Several studies have also shown that ensemble DNNs are robust against out-of-sample data, making it an ideal approach for machine learning-enabled medical imaging tasks. In this work, we analyze deep ensembles for the task of classifying true and false lung nodule candidates in computed tomography (CT) volumes. Six ImageNet pretrained DNN models with minimal modifications for lung nodule classification were used to generate 63 ensemble DNNs using all possible combinations of DNN models. The checkpoint predictions during the training of the DNN models were used as a surrogate to understand the training trajectories each model took to result in the finalized model. The predictions from each checkpoint across the six DNN models were projected to a 2-dimensional space using uniform manifold approximation and projection method. The output scores from these six models were compared using a rank-biased overlap measure that incorporates larger weights for top scoring candidates and the ability to handle arbitrary sized list of candidates. Both these analyses indicate that diversity in the training process leads to diversity of the scores for the same training and test samples. The competition performance metric (CPM) from the free-response operating characteristic curve shows that as the number of DNN models in each ensemble increases, the CPM increases from an average of 0.750 to 0.79.

Conference Presentation

Citation Download Citation

Ravi K. Samala, Berkman Sahiner, Gene Pennello, Kenny H. Cha, Mohammad Mehdi Farhangi, and Nicholas Petrick "Deciphering deep ensembles for lung nodule analysis", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 120330L (4 April 2022); https://doi.org/10.1117/12.2612023

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available