SignificanceThere is a significant need for the generation of virtual histological information from coronary optical coherence tomography (OCT) images to better guide the treatment of coronary artery disease (CAD). However, existing methods either require a large pixel-wise paired training dataset or have limited capability to map pathological regions.AimThe aim of this work is to generate virtual histological information from coronary OCT images, without a pixel-wise paired training dataset while capable of providing pathological patterns.ApproachWe design a structurally constrained, pathology-aware, transformer generative adversarial network, namely structurally constrained pathology-aware convolutional transformer generative adversarial network (SCPAT-GAN), to generate virtual stained H&E histology from OCT images. We quantitatively evaluate the quality of virtual stained histology images by measuring the Fréchet inception distance (FID) and perceptual hash value (PHV). Moreover, we invite experienced pathologists to evaluate the virtual stained images. Furthermore, we visually inspect the virtual stained image generated by SCPAT-GAN. Also, we perform an ablation study to validate the design of the proposed SCPAT-GAN. Finally, we demonstrate 3D virtual stained histology images.ResultsCompared to previous research, the proposed SCPAT-GAN achieves better FID and PHV scores. The visual inspection suggests that the virtual histology images generated by SCPAT-GAN resemble both normal and pathological features without artifacts. As confirmed by the pathologists, the virtual stained images have good quality compared to real histology images. The ablation study confirms the effectiveness of the combination of proposed pathological awareness and structural constraining modules.ConclusionsThe proposed SCPAT-GAN is the first to demonstrate the feasibility of generating both normal and pathological patterns without pixel-wisely supervised training. We expect the SCPAT-GAN to assist in the clinical evaluation of treating the CAD by providing 2D and 3D histopathological visualizations.
Histopathological information is critical to identify diseased region in coronary tissues, with great potential to guide the treatment of coronary artery disease. We develop a pathology-aware generative adversarial network (GAN) to generate virtual histology images from coronary optical coherence tomography (OCT) images. The proposed network integrates transformer network structure with a cycleGAN framework. Our algorithm advances existing cycleGAN-based method with a lower value of Frechet Inception distance, as demonstrated by a cross-validation experiment from a human coronary dataset. Our work incorporates histopathological visualization into real-time OCT imaging, holding great potential to assist diagnostic and therapeutic applications of cardiovascular diseases.
The magnetically controlled capsule endoscopy (MCCE) is an emerging modality for assessing gastrointestinal disorders due to its advantages. However, current assignments of MCCE rely on manual controlling and gastric landmarks, which are prone to omissions. We improve the scanning protocol of the MCCE in human gastric using both manual and automatic controlling methods. We design a quantitative scanning coverage ratio to measure the process of MCCE scanning within the human gastric. The proposed scanning coverage ratio is capable of guiding the manual and automatic scanning process of human gastric. Moreover, we design a deep reinforcement learning (DRL) controller for automatically navigating the capsule. Our DRL controller achieves a higher coverage ratio compared to previous research.
KEYWORDS: Electronic filtering, Video, Education and training, Cameras, Diseases and disorders, Deep learning, Tunable filters, Optical filters, Endoscopes, Algorithm development
Gastric motility disorders are caused by abnormal muscle contractions which may impede the digestive process. Traditional approaches for evaluating human gastric motility have limitations, including discomfort, use of sedation, risk of radiation exposure, and confusion in interpretation. Magnetically controlled capsule endoscopy (MCCE) provides a new way to evaluate human gastric with the advantages of comfort, safety, and no anesthesia. In this paper, we develop deep learning algorithms to detect human gastric waves captured by MCCE. We demonstrate promising experimental results both qualitatively and quantitatively. Our methods have great potential to assist in the diagnosis of human gastric disease by evaluating gastric motility.
SignificanceOptical coherence tomography (OCT) has become increasingly essential in assisting the treatment of coronary artery disease (CAD). However, unidentified calcified regions within a narrowed artery could impair the outcome of the treatment. Fast and objective identification is paramount to automatically procuring accurate readings on calcifications within the artery.AimWe aim to rapidly identify calcification in coronary OCT images using a bounding box and reduce the prediction bias in automated prediction models.ApproachWe first adopt a deep learning-based object detection model to rapidly draw the calcified region from coronary OCT images using a bounding box. We measure the uncertainty of predictions based on the expected calibration errors, thus assessing the certainty level of detection results. To calibrate confidence scores of predictions, we implement dependent logistic calibration using each detection result’s confidence and center coordinates.ResultsWe implemented an object detection module to draw the boundary of the calcified region at a rate of 140 frames per second. With the calibrated confidence score of each prediction, we lower the uncertainty of predictions in calcification detection and eliminate the estimation bias from various object detection methods. The calibrated confidence of prediction results in a confidence error of ∼0.13, suggesting that the confidence calibration on calcification detection could provide a more trustworthy result.ConclusionsGiven the rapid detection and effective calibration of the proposed work, we expect that it can assist in clinical evaluation of treating the CAD during the imaging-guided procedure.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.