Continual pretraining for enhanced multi-organ segmentation from CT images

Yaqi Yang; Chen Shen; Yucheng Tang; Holger R. Roth; Masahiro Oda; Yuichiro Hayashi; Kazunari Misawa; Kensaku Mori

doi:10.1117/12.3006630

2 April 2024 Continual pretraining for enhanced multi-organ segmentation from CT images

Yaqi Yang, Chen Shen, Yucheng Tang, Holger R. Roth, Masahiro Oda, Yuichiro Hayashi, Kazunari Misawa, Kensaku Mori

Proceedings Volume 12926, Medical Imaging 2024: Image Processing; 129260K (2024) https://doi.org/10.1117/12.3006630
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

Self-supervised pretraining has shown great performance in improving the accuracy of downstream tasks. Although pretraining on a large dataset improves performances, it becomes challenging to further optimize the model by solely enlarging the dataset. In contrast, additional adaptation of pretrained models to the target domain has shown promise in NLP. Inspired by the success of continual pretraining, we investigated the efficacy of adapting the target domain dataset to a pretrained model in medical imaging, particularly in the context of segmentation. We present a study based on a self-supervised pretraining framework using the SwinUNETR backbone. In this study, we improved the generalizability of the self-supervised pretraining by adapting a foundational model pretrained on 5k CT volumes to data of the downstream segmentation task. In detail, we employed 385 abdominal CT volumes for the continual task-adaptive pretraining and 24 abdominal CT volumes for the downstream segmentation task, all sourced from the same dataset. Additionally, we conducted comparative experiments to demonstrate the benefits of this task-adapting pretraining approach. Our method has shown that continual pretraining helps to improve the performances, achieving an average Dice score for 10-class organ segmentation of 87.8%.

Conference Presentation

Citation Download Citation

Yaqi Yang, Chen Shen, Yucheng Tang, Holger R. Roth, Masahiro Oda, Yuichiro Hayashi, Kazunari Misawa, and Kensaku Mori "Continual pretraining for enhanced multi-organ segmentation from CT images", Proc. SPIE 12926, Medical Imaging 2024: Image Processing, 129260K (2 April 2024); https://doi.org/10.1117/12.3006630

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available