Volumetric bioimaging via dual-resonant scanning multiphoton microscopy with 3D-generator U-Net

Chai-Wei Hsu; Sumesh Nair; Chun-Yu Lin; Shean-Jen Chen

doi:10.1117/12.2673721

11 August 2023 Volumetric bioimaging via dual-resonant scanning multiphoton microscopy with 3D-generator U-Net

Chai-Wei Hsu, Sumesh Nair, Chun-Yu Lin, Shean-Jen Chen

Proceedings Volume 12622, Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI; 126220G (2023) https://doi.org/10.1117/12.2673721
Event: SPIE Optical Metrology, 2023, Munich, Germany

Abstract

Multiphoton microscopy is a powerful technique for in-vivo bioimaging. Many high-speed volumetric methods have been integrated with multiphoton microscopy to achieve dynamic signal imaging. In this study, we have developed a Dual-Resonant Scanning Multiphoton (DRSM) microscope that a frame rate of around 8,000 Hz and a volumetric imaging rate of over 30 Hz can be obtained for a big image volume of 343×343×120 μm³ with a large image size of 256×256×80 voxels. The practical feasibility of the DRSM microscope is demonstrated by observing the mushroom bodies of a drosophila brain and performing 3D dynamic observations of moving 10-μm fluorescent beads. However, the volumetric images have a severe negative Signal-to-Noise Ratio (SNR) as a result of a large number of missing voxels for a large scanning volume and the presence of Lissajous patterning residuals. Due to this drawback and a large number of missing voxels in DRSM, a 3D-generator U-Net model is used to inpaint and denoise the images. The results show that the model achieves dynamic volumetric imaging to be performed with significant SNR improvement. The performance of the 3D U-Net model for bioimaging applications is enhanced by training the model with high-SNR in-vitro drosophila brain images captured using a conventional point scanning multiphoton microscope. Through the assistance of transfer learning, the model can be extended to the restoration of in-vivo drosophila brain images with a high image quality and a rapid training time.

Citation Download Citation

Chai-Wei Hsu, Sumesh Nair, Chun-Yu Lin, and Shean-Jen Chen "Volumetric bioimaging via dual-resonant scanning multiphoton microscopy with 3D-generator U-Net", Proc. SPIE 12622, Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI, 126220G (11 August 2023); https://doi.org/10.1117/12.2673721

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
3 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

Image quality

Microscopes

3D image processing

Image restoration

Multiphoton microscopy

Education and training

Show All Keywords

Keywords/Phrases

Search In:

Publication Years