Pushing the limits of zero-shot self-supervised super-resolution of anisotropic MR images

Samuel W. Remedios; Shuwen Wei; Blake E. Dewey; Aaron Carass; Dzung L. Pham; Jerry L. Prince

doi:10.1117/12.3007304

2 April 2024 Pushing the limits of zero-shot self-supervised super-resolution of anisotropic MR images

Samuel W. Remedios, Shuwen Wei, Blake E. Dewey, Aaron Carass, Dzung L. Pham, Jerry L. Prince

Proceedings Volume 12926, Medical Imaging 2024: Image Processing; 1292606 (2024) https://doi.org/10.1117/12.3007304
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

Magnetic resonance images are often acquired as several 2D slices and stacked into a 3D volume, yielding a lower through-plane resolution than in-plane resolution. Many super-resolution (SR) methods have been proposed to address this, including those that use the inherent high-resolution (HR) in-plane signal as HR data to train deep neural networks. Techniques with this approach are generally both self-supervised and internally trained, so no external training data is required. However, in such a training paradigm limited data are present for training machine learning models and the frequency content of the in-plane data may be insufficient to capture the true HR image. In particular, the recovery of high frequency information is usually lacking. In this work, we show this shortcoming with Fourier analysis; we subsequently propose and compare several approaches to address the recovery of high frequency information. We test a particular internally trained self-supervised method named SMORE on ten subjects at three common clinical resolutions with three types of modification: frequency-type losses (Fourier and wavelet), feature-type losses, and low-resolution re-gridding strategies for estimating the residual. We find a particular combination to balance between signal recovery in both spatial and frequency domains qualitatively and quantitatively, yet none of the modifications alone or in tandem yield a vastly superior result. We postulate that there may either be limits on internally trained techniques that such modifications cannot address, or limits on modeling SR as finding a map from low-resolution to HR, or both.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Samuel W. Remedios, Shuwen Wei, Blake E. Dewey, Aaron Carass, Dzung L. Pham, and Jerry L. Prince "Pushing the limits of zero-shot self-supervised super-resolution of anisotropic MR images", Proc. SPIE 12926, Medical Imaging 2024: Image Processing, 1292606 (2 April 2024); https://doi.org/10.1117/12.3007304

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available