Unsupervised segmentation of micro-CT images based on a hybrid of variational inference and adversarial learning

Takayasu Moriya; Holger R. Roth; Shota Nakamura; Hirohisa Oda; Masahiro Oda; Kensaku Mori

doi:10.1117/12.2513094

15 March 2019 Unsupervised segmentation of micro-CT images based on a hybrid of variational inference and adversarial learning

Takayasu Moriya, Holger R. Roth, Shota Nakamura, Hirohisa Oda, Masahiro Oda, Kensaku Mori

Author Affiliations +

Proceedings Volume 10953, Medical Imaging 2019: Biomedical Applications in Molecular, Structural, and Functional Imaging; 109530L (2019) https://doi.org/10.1117/12.2513094
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

This paper presents a novel unsupervised segmentation method for the 3D microstructure in micro-computed tomography (micro-CT) images. Micro-CT scanning of resected lung cancer specimens can capture detailed and surrounding anatomical structures of them. However, its segmentation is difficult. Recently, many unsupervised learning methods have become greatly improved, especially in their ability to learn generative models such as variational auto-encoders (VAEs) and generative adversarial networks (GANs). Meanwhile, however, most of the recent segmentation methods using deep neural networks continue to rely on supervised learning. Therefore, it is rather difficult for these segmentation methods to cope with the growing number of unlabeled micro-CT images. In this paper, we develop a generative model that can infer segmentation labels by extending α-GAN, a principled combination that iterates variational inference and adversarial learning. Our method consists of two phases. In the first phase, we train our model by iterating two steps: (1) inferring pairs of continuous and discrete latent variables of image patches randomly extracted from an unlabeled image and (2) generating image patches from the inferred pairs of latent variables. In the second phase, our trained model assigns labels to patches from a target image in order to obtain the segmented image. We evaluated our method using three micro-CT images of a lung cancer specimen. The aim was to automatically divide each image into three regions: invasive carcinoma, noninvasive carcinoma, and normal tissue. Our experiments show promising results both quantitatively and qualitatively.

Conference Presentation

Citation Download Citation

Takayasu Moriya, Holger R. Roth, Shota Nakamura, Hirohisa Oda, Masahiro Oda, and Kensaku Mori "Unsupervised segmentation of micro-CT images based on a hybrid of variational inference and adversarial learning", Proc. SPIE 10953, Medical Imaging 2019: Biomedical Applications in Molecular, Structural, and Functional Imaging, 109530L (15 March 2019); https://doi.org/10.1117/12.2513094

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available