Simultaneous segmentation and classification of multichannel immuno-fluorescently labeled confocal microscopy images using deep convolutional neural networks

Adam R. Sibley; Vladimir Liarski; Marcus Clark; Maryellen L. Giger

doi:10.1117/12.2292934

6 March 2018 Simultaneous segmentation and classification of multichannel immuno-fluorescently labeled confocal microscopy images using deep convolutional neural networks

Adam R. Sibley, Vladimir Liarski, Marcus Clark, Maryellen L. Giger

Author Affiliations +

Proceedings Volume 10581, Medical Imaging 2018: Digital Pathology; 1058110 (2018) https://doi.org/10.1117/12.2292934
Event: SPIE Medical Imaging, 2018, Houston, Texas, United States

Abstract

The feasibility of localizing, segmenting, and classifying individual cells in multi-channel confocal microscopy images is highly dependent on image quality. In certain applications, with good image quality, the segmentation can be trivial and accomplished via thresholding, watershed, or a collection of other well-established and studied heuristics; however, at the limit of poor image quality and complex image features, these techniques fail. It is at this limit that deep convolutional neural network (DCNN) approaches excel. Our research studies the interaction of individual immune cells and their shape changes relative to inflammatory immune reactions¹ using multi-channel immunofluorescence imaging of renal biopsies from patients with inflammatory kidney disease. We present here a deep learning methodology for application to nuclear and cell membrane immunofluorescent stains to automatically segment and classify multiple T-cell and dendritic cell types. With both T-cells and dendritic cells segmented, we are able to study how T-cells with different surface antigens change shape with proximity to dendritic cells. Shape changes are seen when T-cells move close to dendritic cells and interact. We use a sliding window, max-filtering DCNN to segment and classify 3 cell types from 6 image stains channels within a single DCNN. This DCNN maintains images at original resolution throughout the network using dilated convolutions and max-filtering in place of max pooling layers. In addition, we use 3D convolution kernels with two spatial dimensions and one channel dimension. This allows us to output a multi-class binary classification based on multichannel data at the original image resolution. We trained and validated the network across 24 patients with 8,572 segmented cells. Our results demonstrate a mean Dice-Sorensen score of 0.78 +/- 0.18, a mean classification sensitivity of 0.76, and a mean classification specificity of 0.75 across all 3 segmented cell types.

Citation Download Citation

Adam R. Sibley, Vladimir Liarski, Marcus Clark, and Maryellen L. Giger "Simultaneous segmentation and classification of multichannel immuno-fluorescently labeled confocal microscopy images using deep convolutional neural networks ", Proc. SPIE 10581, Medical Imaging 2018: Digital Pathology, 1058110 (6 March 2018); https://doi.org/10.1117/12.2292934

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available