An extensive pixel-level augmentation framework for unsupervised cross-modality domain adaptation

Maria G. Baldeon Calisto; Susana K. Lai-Yuen

doi:10.1117/12.2651462

3 April 2023 An extensive pixel-level augmentation framework for unsupervised cross-modality domain adaptation

Maria G. Baldeon Calisto, Susana K. Lai-Yuen

Proceedings Volume 12464, Medical Imaging 2023: Image Processing; 124641I (2023) https://doi.org/10.1117/12.2651462
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Conference Poster

Abstract

Convolutional neural networks (CNNs) have achieved great success in automating the segmentation of medical images. Nevertheless, when a trained CNN is tested on a new domain there is a performance degradation due to the distribution shift. In this work, we present an unsupervised Extensive Pixel-level Augmentation framework (EPA) for cross-modality domain adaptation. EPA implements a two-phase image- and feature-level adaptation method. In the first phase, the source domain images are mapped to target domain in pixel space using the CycleGAN, StAC-DA, and CUT translation models. This creates an augmented translated dataset 3 times bigger than the original. In phase 2, a deeply supervised U-Net network is trained to segment the target images using a semi-supervised adversarial learning approach. In particular, a set of discriminator networks are trained to distinguish between the target and source domain segmentations, while the U-Net aims to fool them. EPA is tested on the task of brain structure segmentation from the Crossmoda 2022 Grand Challenge, being ranked within the top 12 submissions of the testing phase. Moreover, we demonstrate that augmenting the size of the mapped dataset through distinct translation methods is crucial for increasing the segmentation accuracy of the model.

Citation Download Citation

Maria G. Baldeon Calisto and Susana K. Lai-Yuen "An extensive pixel-level augmentation framework for unsupervised cross-modality domain adaptation", Proc. SPIE 12464, Medical Imaging 2023: Image Processing, 124641I (3 April 2023); https://doi.org/10.1117/12.2651462

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available