11 June 2024 Transformer-based generative adversarial network enabled direct aberration determination
Sitong Chen, Zihao Zhu, Hao Wang, Yangyundou Wang
Author Affiliations +
Abstract

Structured illumination microscopy (SIM) has emerged as a powerful technique, surpassing the limitations imposed by optical diffraction and providing remarkable enhancements in both lateral and axial resolution compared with traditional diffraction-limited microscopy. However, it does come with certain limitations, including the need for a complex optical setup, extensive image acquisition, and computationally intensive post-processing. Motivated by the advancements in deep-learning-based super-resolution techniques, we propose an original three-dimensional (3D) representative learning algorithm called the transformer-based generative adversarial network (TransGAN), which can accurately predict corresponding aberrations through a combination of 17 mixed Zernike modes. Our approach outperforms state-of-the-art algorithms in various cellular structures, achieving impressive results with a mean square error of 2.358×105 for aberration determination. TransGAN presents a promising solution for enhancing SIM imaging, offering improved resolution and precise aberration estimation. This technique exhibits significant potential in overcoming the limitations associated with 3D SIM techniques and advancing the field of 3D optical microscopy.

© 2024 Society of Photo-Optical Instrumentation Engineers (SPIE)
Sitong Chen, Zihao Zhu, Hao Wang, and Yangyundou Wang "Transformer-based generative adversarial network enabled direct aberration determination," Optical Engineering 63(6), 063102 (11 June 2024). https://doi.org/10.1117/1.OE.63.6.063102
Received: 8 January 2024; Accepted: 19 May 2024; Published: 11 June 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
3D image processing

3D modeling

Point spread functions

Feature extraction

Transformers

Optical engineering

Zernike polynomials

Back to Top