Identification of molecular cell type of breast cancer on digital histopathology images using deep learning and multiplexed fluorescence imaging

Wenchao Han; Alison M. Cheung; Vishwesh Ramanathan; Dan Wang; Kela Liu; Martin J. Yaffe; Anne L. Martel

doi:10.1117/12.2654943

6 April 2023 Identification of molecular cell type of breast cancer on digital histopathology images using deep learning and multiplexed fluorescence imaging

Wenchao Han, Alison M. Cheung, Vishwesh Ramanathan, Dan Wang, Kela Liu, Martin J. Yaffe, Anne L. Martel

Author Affiliations +

Proceedings Volume 12471, Medical Imaging 2023: Digital and Computational Pathology; 1247106 (2023) https://doi.org/10.1117/12.2654943
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

ER, PR (estrogen, progesterone receptor), and HER2 (human epidermal growth factor receptor 2) status are assessed using immunohistochemistry and reported in standard clinical workflows as they provide valuable information to help treatment planning. The protein Ki67 has also been suggested as a prognostic biomarker but is not routinely evaluated clinically due to insufficient quality assurance. The routine pathological practice usually relies on small biopsies, such that the reduction in consumption is necessary to save materials for special assays. For this purpose, we developed and validated an automatic system for segmenting and identifying the (ER, PR, HER2, Ki67) positive cells from hæmatoxylin and eosin (H&E) stained tissue sections using multiplexed immunofluorescence (MxIF) images at cellular level as a reference standard. In this study, we used 100 tissue-microarray cores sampled from 56 cases of invasive breast cancer. For ER, we extracted cell nucleus images (HoverNet) from the H&E images and assigned each cell nucleus as ER positive vs. negative based on the corresponding MxIF signals (whole cell segmentation with DeepCSeg) upon H&E to MxIF image registration. We trained a Res-Net 18 and validated the model on a separate test-set for classifying the cells as positive vs. negative for ER, and performed the same experiment for the other three markers. We obtained area-under-the- receiver-operating-characteristic-curves (AUCs) of 0.82 (ER), 0.85 (PR), 0.75 (HER2), 0.82 (Ki67) respectively. Our study demonstrates the feasibility of using machine learning to identify molecular status at cellular level directly from the H&E slides.

Conference Presentation

Citation Download Citation

Wenchao Han, Alison M. Cheung, Vishwesh Ramanathan, Dan Wang, Kela Liu, Martin J. Yaffe, and Anne L. Martel "Identification of molecular cell type of breast cancer on digital histopathology images using deep learning and multiplexed fluorescence imaging", Proc. SPIE 12471, Medical Imaging 2023: Digital and Computational Pathology, 1247106 (6 April 2023); https://doi.org/10.1117/12.2654943

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available