AI-enabled high-speed photoacoustic endomicroscopy through a multimode fibre

Tianrui Zhao; Mengjie Shi; Sébastien Ourselin; Tom Vercauteren; Wenfeng Xia

doi:10.1117/12.2607783

3 March 2022 AI-enabled high-speed photoacoustic endomicroscopy through a multimode fibre

Tianrui Zhao, Mengjie Shi, Sébastien Ourselin, Tom Vercauteren, Wenfeng Xia

Proceedings Volume 11960, Photons Plus Ultrasound: Imaging and Sensing 2022; 119600L (2022) https://doi.org/10.1117/12.2607783
Event: SPIE BiOS, 2022, San Francisco, California, United States

Abstract

Photoacoustic (PA) endoscopy promises to be useful in a variety of clinical contexts including intravascular imaging, gastrointestinal tracts imaging and surgical guidance. Recent advancements of optical wavefront shaping allow the development of ultrathin endoscopy probes based on multimode optical fibres, which can provide higher spatial resolution than previously reported fibre bundle-based endoscopes. In this work, we developed a forward-viewing PA endomicroscopy imaging system and further improved its performance with a deep image prior (DIP) neural network. Laser was focused and scanned through a multimode fibre via wavefront shaping, in which a real-valued intensity transmission matrix approach was used for fibre characterisation, and a digital micromirror device (DMD) was used for light modulation. The excited ultrasound waves at the distal fibre tip were detected by an ultrasound transducer. High fidelity images of ex vivo mouse red blood cells were acquired. A DIP neural network was then used to improve the spatial resolution with unsupervised learning. Convolutional filters were used to learn features of low-level images as priors and reconstruct high-resolution images accordingly. The performance of the DIP approach was evaluated using a structural similarity index measure (SSIM) at a level of 0.85 with 25% effective pixels, which outperformed the bicubic method. The use of DIP allows reducing scanning positions by several times, and thus improves the speed of pixel-wise PA microscopy imaging. With further miniaturisation of the ultrasound detector, we anticipate that this system could be used for real-time guidance of minimally invasive surgeries by providing micro-structural, molecular, and functional information of tissue.

Conference Presentation

Citation Download Citation

Tianrui Zhao, Mengjie Shi, Sébastien Ourselin, Tom Vercauteren, and Wenfeng Xia "AI-enabled high-speed photoacoustic endomicroscopy through a multimode fibre", Proc. SPIE 11960, Photons Plus Ultrasound: Imaging and Sensing 2022, 119600L (3 March 2022); https://doi.org/10.1117/12.2607783

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available